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(54) Data structure for image transmission, image coding method, and Image decoding method 

(57) There is provided an image decoding appara- 
tus for decoding a coded image signal having an image 
identifier based on a data structure of the image signal. 
This apparatus comprises a data analyzer for cmalyzing 
the coded image signal with reference to the image 
identifier to decide whether the coded image signal is a 
coded arbitrary shape signal including both of coded 
shape bit streams obtained by coding a shape signal 
which represents the shape of each object as one of the 
components of a display image and coded pixel value 
bit streams obtained by coding a pixel value signal rep- 
resenting the gradation of the object, or a coded binary 
signal including only coded shape bit streams obtained 
by coding a shape signal representing a display image 
of binary information; a first decoder for decoding the 
coded shape bit streams by a first decoding process; 
and a second decoder for decoding the coded pixel 
value bit streams by a second decoding process. The 
first decoding process and the second decoding proc- 
ess are appropriately switched according to each coded 
image signal. Therefore, plural coded image signals 
having different data structures and produced by differ- 
ent coding methods can be decoded in decoding proc- 
esses corresponding to a single coding method. 
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Description 

FigLDOFTHE INVENTION 

The present invention relates to a data structure for 
Image transmission, an image coding method, an image 
decoding method, an image coding apparatus, an 
Image decoding apparatus, a data storage medium 
which contains a program for implementing an intage 
decoding process, and a data storage medium which 
contains a coded image signal. 

More particularly, the Invention relates to a data 
structure for image transmission that makes coded 
image signals decodable kjy decoding processes corre- 
sponding to a single coding method, which coded image 
signals have different data structures obtained by cod- 
ing digital image signals corresponding to different 
schemes. Further, the invention relates to an image 
coding method and an image coding apparatus for gen- 
erating a coded image signal having the above- 
desaibed data structure for image transmission, and an 
image decoding method and an image decoding appa- 
ratus for decoding a coded Image signal having the data 
structure for image transmission. 

Furthermore, tiie invention relates to a data storage 
medium containing a program for inplementing the 
decoding process according to the above-described 
image decoding method, and a data storage medium 
ix)ntaining a coded image signal having the above- 
described data structure 16r image transmission. 

BACKGROUND OF THE INVENTION 

In order to store or transmit digital image infomia- 
tion witii high efficiency, it Is necessary to compressively 
code the digital image information. As a typical method 
for compressive coding of digital image information, 
there is DOT (Discrete Cosine Transformation) repre- 
sented by JPEG (Joint Photographic Experts Group) 
and MPEG (Moving Picture Experts Group). Besides, 
there are waveform coding methods such as sub-band 
coding, wavelet coding, and fractal coding. 

Further, in order to eliminate redundarrt image infor- 
mation between display images, such as adjacent 
frames, Inter-frame prediction using motion compensa- 
tion is carried out.'TTiat Is. a pixel value of a pixel in tiie 
present frame is expressed using a difference between 
this pixel value and a pixel value of a pixel in tiie previ- 
ous frame, and this difference signal is subjected to 
waveform coding. 

To be specific, an arittimetic encoder 10a as shown 
in figure 22(a) is employed for coding a binary image 
signal S2 which represents a display image of binary 
information and is obtained from a scanner of a facsim- 
ile machine or the like. For decoding a coded binary sig- 
nal E2, an arithmetic decoder 10b is employed as 
shown in figure 22(b). The arithmetic encoder 10a 
encodes tiie binary Image signal 82 t>y an arltiimetic 



coding process which is used when transmitting a fac- 
simile signal, such asMMR (Modified Modified Reed) or 
JBIG (Joint Bi-level Image Coding Experts Group), 
tiiereby generates a coded binary signal E2. The aritii- 

s metic decoding apparatus 10b decodes the coded 
binary signal E2 by an arithmetic decoding process cor- 
responding to the arithmetic coding process, tiiereby 
regenerates a decoded binary signal D2. 

As shown in figure 22(c), a coded binary signal 

10 600a (E2) corresponding to one display image includes 
a synchronous signal 601 at the t>eginning, a header 
603 that follows signal 601 , and shape data 604 that fol- 
lows tiie header 603. 

Further, an image coding apparatus 20 shown in 

15 figure 23(a) is employed for coding a digital image sig- 
nal St treated in MPEG2, and an image decoding appa- 
ratus 25 shown in figure 23(b) is employed for decoding 
a coded image signal EL The digital Image signal St 
treated in MPEG2 Is a rectangle image signal which 

20 includes a luminance signal and a color difference sig- 
nal for color display (gradation display), and information 
showing tiie horizontal and vertical size of an image on 
one display Image (one frame). The image coding appa- 
ratus 20 comprises an information source encoder 20a 

£5 which subjects tiie digital image signal (rectangle image 
signal) St to information source coding, and a variable- 
lengtti encoder 20b which sutjects tiie output from ttie 
encoder 20a to variable-lengtii coding to generate a 
coded image signal (coded pixel value sIgnaO Et The 

30 Image decoding apparatus 25 comprises a variable- 
lengtii decoder 25b which subjects the coded image 
signal Et to variat)le-length decoding, and an informa- 
tion source decoder 25a which subjects the output from 
tiie decoder 25b to information source decoding to gen- 

35 erate a decoded Image signal (decoded pixel value sig- 
nal) Dt. 

The information source encoder 20a comprises a 
DCT processor 21 which sutsjects each of plural blocks, 
into which a display image (one frame) is divided, to 

40 DCT piscrete Cosine Transform), and a quantizer 22 
which quantizes tiie output from tiie DCT processor 21 . 
The information source decoder 25a conprises an 
inverse quantizer 26 which inversely quantizes tiie out- 
put from tiie variable-lengtii decoder 25b, and an IDCT 

45 processor 27 which subjects the output from the 
decoder 25b to inverse DCT As shown in figure 23(c), a 
coded image signal 700a (Et) corresponding to one dis- 
play image includes a 32-bit synchronous signal 701 at 
tiie beginning, a header 703 ttiat follows signal 701 , and 

50 coded pixel value bit streams (coded tecture bit 
streams) 71 Cl. 71 C2, 71 C3, ... corresponding to blodG 
CI. C2, C3. into which the display image is divkied, 
respectively The coded texture bit streams 71 CI, 
71C2. and 71 03 include 5-bit quantization scales 704, 

55 707, and 710, variatile-lengtti texture motion vectors 
(MV) 705, 708, and 711, and variable-lengtii texture 
DCT coefficients 706, 709. and 712, respectively. 
In recent years, a method for compressivety coding 
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and transmitting an image signal In the basis of indivicl- 
ual ot^ect has been put to practical use. i^ore specifi- 
cally, an imaget oonresponding to one display image and 
composed of plural ejects, is subjected to compressive 
coding and transmission In an object-wise manner, 
thereby increases the data compression ratio and ena- 
bles decodingAeproducing of the objects separately. In 
this method, on the reproduction end. coded image sig- 
nals corresponding to the respective objects are 
decoded and reproduced, and the reproduced image 
signals are synthesized to display an image corre- 
sponding to one display image. This object't)y-object 
coding enables the user to freely combine images of 
objects to be displayed, whereby editing of a moving 
picture is facilitated. Furthennore. in this method, it is 
possible to display a moving picture without reprodudng 
images of relatively unimportant oksjects, according to 
the congestion of the transmission line, the perform- 
ance of reproduction apparatus, and the preference of 
the viewer. In other words, scalability in object units, i.e.. 
to change the contraction scale off image display for 
each object, is realized. 

In the object-by-object compressive coding of an 
Image signal, since the respective objects have different 
shapes, an image signal of an arbitrary shape image 
(hereinafter, referred to as an arbitrary shape image sig- 
naO is subjected to compressive coding. The arbitrary 
shape image signal includes a texture signal (pixel 
value signal) for color display of an object (gradation dis- 
play) and comprising a luminance signal and a color dif- 
ference signal, and a shape signal representing the 
shape of an image. The shape signal indicates whether 
each pixel as a component of a display region is located 
outside the object or inside the object, and it is 
expressed by binary digit. 

Further, there is a case where the arbitrary shape 
image signal includes transparency information repre- 
senting the transparency of an object when the object is 
placed as a foreground image on a bacl<ground image, 
in addition to the texture signal and the shape signal. 
The transparency information is usually expressed by a 
multivalued transparent signal of at least three bits. A 
combination of the binary shape signal (binary transpar- 
ency signal) and the multivalued transparency signal is 
called a transparency signal. The multivalued transpar- 
ency signal in the transparency signal is treated identi- 
cally to a texture signal in the fbllowing coding process. 

When an arbitrary shape image signal including 
both of a texture signal and a binary shape signal is 
coded, initially, the ^lape signal is coded and. thereaf- 
ter, the texture signal is coded. In MPEG4, coding, 
transmission, and decoding of such an arbitrary shape 
image signal are being standardized, and figure 24(a) is 
a block diagram showing an image coding apparatus 
which perfams a coding process cun-ently being stand- 
ardized as MPEG4. 

In figure 24(a), reference numeral 200a designates 
an innge coding apparatus which extracts an arbitrary 



shape Image signal Sp corresponding to each of plural 
objects constituting a display image, according to a 
video signal Sv output from a camera or an image 
reooiding/ireproduction apparatus (VTR), and encodes 

5 the ark)itrary shape image signal. 

The image coding apparatus 200a includes a chro- 
makey processor 201 which subjects the video signal 
Sv to a chromakey process as follows. Initially, the chro- 
makey processor 201 separates an arbitrary shape 

10 image signal corresponding to each object from a back- 
ground Image signal to a shape signal Spk representing 
the shape of the object as binary Infbnnation and a tex- 
ture signal (pixel value signal) Spt fbr color display of the 
object and comprising a luntinance signal and a color 

IS difference signal. Then, the chromakey processor 201 
outputs the signals Spk and Spt fbr each of plural blocte 
into which a display region corresponding to each object 
on the display Image is divided. When outputting the 
signals Spk and Spt. the chromakey processor 201 out- 

20 puts a switch timing signal Ts representing the timing of 
switching between the shape signal Spk and the texture 
signal Spt Further, the image coding apparatus 200a 
includes an arithmetic encoder 120a which codes the 
shape signal SpK block by block, by arithmetic coding 

25 (refer to JBiQ); an infomiation source encoder 130a 
which perfonns OCT and quantization of the texture sig- 
nal Spt block by block; and a variat>le-length encoder 
1 39 which performs variable-length coding of the output 
from the information source encoder 130a. 

30 Further, the Image coding apparatus 200a includes 
a switch 202 which connects the output from the chro- 
makey processor 201 with one of the input of the arith- 
metic encoder 120a and the input of the information 
source encoder 130a, in response to a switch timing 

35 signal Ts; and a multiplexer 150 which multiplexes a 
coded shape bit stream Epk output from the arithmetic 
encoder 1 20a and a coded texture bit stream Ept output 
from the variable-length encoder 139 together with 
other necessary signals. As shown in figure 24(c), a 

40 coded arbitrary shape signal Ep (500a), in which coded 
shape bit streams (Epl^ 51 A1 . 51 A2, and 51 A3, coded 
texture bit streams (Ept) 52A1. 52A2, and 52A3. and 
other necessary signals are arranged in prescribed 
order, is output from the multiplexer 150. 

45 The above-described arithmetic coding process is 
adopted in a method of transmitting a facsimile signal, 
such as MMR or JBIQ, and the aboveKlescribed DCT 
process is adopted in the MPEG standard. As shown in 
figure 24(c), the coded data of each of blocks A1, A2 

50 and A3 is conrposed of the coded shape bit stream Epk 
and the coded texture bit stream Ept 

In the coding apparatus 200a so constructed, the 
video signal Sv is processed by the chromakey proces- 
sor 201 , and an arbitrary shape image signal Sp confe- 
ss spending to each object is output from the chromakey 
processor 201. The shape signal Spk included in the 
artxtrary shape image signal Sp Is input to the arithme- 
tic encoder 120a by the switch 202 controlled by the 
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switch timing signal Is. coded by the encoder 120a. and 
output as a coded shape bit stream Epk toward the mul- 
tiplexer 150. On the other hand, the texture signal Spt 
included in the arbitrary shape image signal Sp Is input 
to the information source encoder 130a by the switch 5 
202 controlled by the switch timing signal Ts, subjected 
to DCT and quantization in the encoder 130a, and out- 
put as a coded texture bit stream Ept toward the multi- 
plexer 150. The coding of the shape signal Spk and the 
coding of the texture signal Spt are carried out block by 
block. 

In the multiplexer 150, the coded shape bit stream 
Epk, the coded texture bit stream Ept, and other 
required signals are arranged In prescribed order, and 
these streams and signals are output from the multi- 
plexer 150 as a coded arbitrary shape signal Ep. 

The image decoding apparatus 200b shown in fig- 
ure 24(b) is used for decoding of the arbitrary shape sig- 
nal Ep whk;h has been coded by the image coding 
apparatus 200a. 

The image decoding apparatus 200b comprises a 
data analyzer 160 which analyzes the coded artutrary 
shape signal Ep and outputs a control signal SWb; an 
arithmetic decoder 170a whfoh subjects the coded 
shape bit stream Epk included in the coded arbitrary 
shape signal Ep to block-by-t)lock arithmetic decoding, 
and generates an end timing signal Te when arithmetic 
decoding of one block has ended; an information source 
decoder 180a which subjects the coded texture bit 
stream Ept included In the coded arbitrary shape signal 
Ep to information source decoding, i.e., inverse DCT 
and inverse quantization; a switch 101b which supplies 
the coded arbitrary shape signal Ep output from the 
data analyzer 160 to eitiier flie arithmetic decoder 1 70a 
or the infonnation source decoder 180a. In response to 
the control signal SWb and the end timing signal Te: and 
a syntiiesizer 190 which syntiiesizes outputs Dpk and 
Dpt from tiie decoders 170a and 180a and outputs the 
syntiiesized signal as a decoded artsitrary shape signal 
Pp. 

in tiie image decoding apparatus 200b so con- 
structed, receiving the coded art)itrary shape signal Ep, 
the data analyzer 160 analyzes information included in 
this signal, and outputs the control signal SWb toward 
the switch 101b when it detects tiie last bit of the texture 
bit stream Ept In response to the control signal SWb. 
the switch 101b supplies tiie output from the data ana- 
lyzer 1 60 to the arithmetic decoder 1 70a. The aritiimetic 
decoder 1 70a decodes tine coded shape bit stream Epk, 
and outputs tiie end timing signal Te when decoding of 
the coded shape bit stream Epk corresponding to each 
block has ended. When tiie end timing signal Te is input 
to the data analyzer 160. the data ancUyzer 160 outputs 
the control signal SWb to the switch 101b. and the 
switch 101b connects tiie output of the data analyzer 
160 to the information source decoder 180a. The infor- 
mation source decoder 180a decodes one block of the 
coded texture signal Ept Included In the coded arbitrary 



shape signal Ep. The syntiiesizer 190 synthesizes tiie 
output from the arithmetic decoder 170a and the output 
from the Information source decoder 180a, and outputs 
ttie decoded arbitrary shape signal Dp as a reproduced 
signal. When the above-mentioned decoding process 
has been completed for the coded arbitrary shape sig- 
nal Ep corresponding to one object to generate the 
decoded arbitrary shape signal Dp con-esponding to the 
object, image display of the object is possible. 

AHhough no desaiption is given of processing of an 
arbitrary shape image signal including a multivalued 
transparency signal (arbitrary shape image signal with 
transparency infomnation) with respect to figures 24(a)- 
24(c), the multivalued transparency signal is processed 
in the same manner as the texture signal (pixel value 
signal) if tiie arbitrary shape image signal includes a 
multivalued transparency signal. 

As described above, in the conventional method of 
coding an image signal, tiie aritiimetic coding metiiod 
employed in JBIG or the like is used for coding of a 
binary image signal, i.e.. a binary shape signal, while 
the information source coding method employed In 
MPEG2 or the like is used for coding of a digital image 
signal for color display of an image, i.e.. a texture signal. 
Further, the coding metiiod of MPEG4, i.e.. combination 
of arithmetic coding and information source coding Is 
used tor coding of an image signal including a binary 
shape signal and a texture signal. 

It is a matter of course that, when decoding coded 
signals obtained by different coding mettiods, different 
decoding methods corresponding to tiie respective cod- 
ing methods should be employed. In other words, since 
different coding mettiods are used for coding different 
kinds of image signals in tiie conventional coding proc- 
ess, different data analysis metiiods should be 
employed in the decoding process of the coded signals. 

Although an image decoding apparatus based on 
MPEQ4 is al3le to decode any of coded signals of a 
binary image signal (JBIG), a digital image signal 
(MPEG2), and an arbitrary shape image signal 
(MPEG4), this apparatus has the following drawbacks. 

In a coded arbitrary shape signal obtained by block- 
by-block coding of an arbitrary shape Image signal, 
coded shape bit streams corresponding to tiie respec- 
tive blocks and coded texture bit streams corresponding 
to the respective btocks are alternatingly arranged. On 
tiie ottier hand, in a coded binary signal obtained by 
biock-by-block coding of a binary image signal, coded 
shape bit streams corresponding to the respective 
blocks are successively arranged. Therefore, in the data 
analysis metiiod (data analyzer) according to MPEG4, 
tiie above-described control signal SWb cannot be gen- 
erated by analysis of the coded binary Image signal 
containing no coded texture bit sti-eam. as such tiie 
coded shape bit streams of tiie respective blocks in the 
coded binary signal cannot be successively output 
toward the aritiimetic decoder 170a. To be specific, in 
tiie image decoding apparatus 200b. when processing 
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of a coded shape bit stream corresponding to some 
block has ended, the end timing signal Te is output from 
the arithmetic decoder 170a toward the switch 101bb 
whereby the switch 101b supplies the bit stream from 
the data analyzer 1 60 to the Information source decoder s 
180a. However, since no coded texture bit stream is 
Included in the coded b'nary signal, the data analyzer 
1 60 cannot generate the control signal SWb fbr control- 
ling the switch 1 01 b so that the bit stream is input to the 
arithmetic decoder 1 70a. and a coded shape bit stream 
con-esponding to the next block Is input to the Informa- 
tion source decoder 180a 

IHence. to support coding of the binary Image sig- 
nal, a dummy texture bit stream correspmfing to the 
block is added using the conventional method after the 
coded shape bit stream of each biocK thereby making 
the data structure of the coded binary signal apparently 
identteal to the data structure of the coded artMtrary 
shape signal. In this case, the coded binary signal can 
be analyzed by the data analysis method based on 
MPEG4 and decoded k}y the image decoding process 
based on MPEG4. 

However, since the coded dummy texture bit stream 
Is added to the coded shape bit stream when the coded 
binary image signal Is output, the bit number is wasted 
in the coding process, resulting in a reductton In the 
coding efficiency. 

In the decoding process based on MPEQ4. a coded 
Image signal .(coded pixel value signal), which Is 
obtained by coding a digital Image signal (rectangle 
image signaO con'esponding to MPEQ2 and comprising 
only a texture signal, is decodable as well as a coded 
arbitrary shape signal obtained by coding an arbitrary 
shape image signal. The reason is as fdlcws. In a 
coded image signal including coded texture bit streams, 
since starting point and end point of the coded texture 
bit stream corresponding to each block is detectable, 
the switch 101b can k>e controlled by the control signal 
SWb so that the coded texture bit stream Is always Input 
to the information source decoder 1 80b. 

Further, in the decoding process corresponding to 
the coding process based on MPEG4, if the processing 
Is overloaded, when decoding a coded arbitrary shape 
signal ot>talned by coding an aibitrary shape image sig- 
nal, both of the coded shape bit stream and the coded 
texture bit stream con-esponding to each bkick cannot 
be decoded within a display time that is set in advance, 
as such the motion of image on the display lacks of 
smoothness or stops. 

SUMMARY OF THE INVENTION 

An object of the present inventk>n is to provide a 
data structure for image transmission, an image decod- 
ing method, and an image decoding apparatus, which 
enable decoding of coded Image signals having differ- 
ent data structures obtained by coding digital Image sig- 
nals con'esponding to different schemes or the like, by 



decoding processes corresponding to a single coding 
method, fbr example, those capable of decoding both of 
a binary image signal and an arbitrary shape image sig- 
nal, without increasing the bit number during the coding 
process. 

Another object of the present invention is to provide 
a data storage medium containing a program fbr imple- 
menting the decoding processes according to the 
above-described image decoding method, and a data 
storage medium containing a coded image signal hav- 
ing the above-mentioned data structure fbr image trans- 
mission. 

Still another object of the present invention is to 
provide an Image coding method and an image coding 
apparatus, which can create a coded image signal hav- 
ing a data structure fbr image transmission, which data 
structure enables decoding of coded image signals hav- 
ing different data structures obtained by coding digital 
image signals corresponding to different schemes or 
the like by decoding processes con'esponding to a sin- 
gle coding method, for example, decoding of a binary 
image signal and an arbitrary shape image signal with- 
out increasing the bit number during the coding proc- 
ess. 

Yet another object of the present invention is to pro- 
vide an image decoding apparatus which can r^oduce 
a coded image signal by decoding while maintaining a 
smooth motion of image on a display screen even when 
the load of an arithmetic processor performing the 
decoding is large. 

Other objects and advantages of the invention will 
become apparent from the detailed description that fol- 
lows. The detailed description and specific embodi- 
ments desaibed are provided only tor illustration since 
various additions and modifications within the scope of 
the invention will be apparent to those of skill In the art 
from the detailed description. 

According to a first aspect of the present invention, 
there Is provided a data structure for transmitting a 
coded image signal obtained by coding a digital image 
signal. Including: 

at least coded shape bit streams between the fol- 
lowing two kinds of bit streams: coded shape bit 
streams obtained by coding a shape signal which 
represents a display Image of binary information or 
the shape In binary format of each object as one of 
the components of a display image; and coded pixel 
value bit streams obtained by coding a pixel value 
signal representing the gradation of the object; and 
an image identifier for deciding whether the coded 
image signal includes, as the coded bit streams, 
both of the coded shape bit streams and the coded 
pixel value bit streams, or only the coded shape bit 
streams; 

wherein the image Mentifier and the coded bit 
streams are arranged so that the image klentif ier is 
followed by the coded bit streams. 
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Therefore, by referring to the image identifier, a 
coded signal including no coded pixel value bit streams 
can be analyzed using a data analysis method for a 
coded signal including coded pixel value bit streams. 

According to a second aspect of the present inven- s 
tion, in the above<lesaibed data structure for image 
transmission, the image identifier comprises a 2-bit 
code. Therefore, it is possible to realize decoding proc- 
esses for four kinds of coded image signals including a 
coded binary signal and a coded arbitrary shape signal. 10 
conresponding to a single coding method. 

According to a third aspect of the present invention, 
there is provided an image coding method receiving a 
digital image signal, and subjecting the digital image 
signal to a coding process according to the data struc- is 
ture off the digital image signal, wherein: 

it is decided whether the digital image signal is a 
binary image signal including, as data for display, 
only a shape signal representing a display image of 20 
binary information, or an arbitrary shape image sig- 
nal including, as data for display, both of a shape 
signal representing the shape of each object as one 
off the components of a display image and a pixel 
value signal representing tiie gradation off the 2s 
object; 

for tiie binary image signal, the shape signal is sub- 
jected to a first coding process and, in tiie coding 
process, an image identifier having a first value is 
generated, thereby creating a coded binary signal 30 
including the image identifier; 
for the arbitrary shape image signal, tiie shape sig- 
nal is subjected to the first coding process while the 
pixel value signal is subjected to a second coding 
process employing a coding method different from 3S 
that of the first coding process and, in the coding 
process, an image identifier having a second value 
is generated, thereby creating a coded arbitrary 
shape signal including tiie image identifier; and 
in response to the input digital image signal, one of 40 
the coded binary signal and tiie coded arbitrary 
shape signal is output. 

Therefore, even though image signals having differ- 
ent data structures are coded by different coding metii- 45 
ods, these coded image signals can be decoded in 
decoding processes corresponding to a single coding 
method. In addition, the bit nunnber hardly increases 
during the coding process. 

According to a fourtii aspect of tiie present inven- so 
tion. in tiie above-described image coding mettiod, tiie 
image identifier comprises a 2-bit code. Therefore, cod- 
ing processes for four kinds of image signals including a 
binary image signal and an arbitrary shape image signal 
are carried out so tiiat coded signals corresponding to ss 
these image signals can be identified at tiie decoding 
end. 

According to a f iftii aspect of the present invention. 
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tiiere is provkled an image coding apparatus receiving a 
digital image signal, and subjecting the digital image 
signal to a coding process according to the data struc- 
ture off the digital image signal, comprising: 

signal identification means for receiving the digital 
infiage signal, and deciding whether the digital 
innage signal is a binary image signal including, as 
data for display, only a shape signal showing a dis- 
play image of binary information, or an arbitrary 
shape image signal including, as data for display, 
both of a shape signal showing ttie shape of each 
object as one of flie components of a display image 
and a pixel value signal representing the gradation 
of the object, and oulputting an identifier signal 
according tiie result of tiie decision; 
signal extraction means for extracting tiie shape 
signal from tiie binary image signal, and tiie shape 
signal and tiie pixel value signal from tiie arbitrary 
shape image signal; 

first coding means for coding the shape signals by 
a first coding process to generate coded shape bit 
streams; 

second coding means for coding tiie pixel value sig- 
nal by a second coding process employing a coding 
metiiod different from that of the first coding proc- 
ess, ttiereby generating coded pixel value bit 
streams; 

signal supply means for selecting, according to the 
identifier signal, one of first and second operations, 
where tiie first operation is to supply the shape sig- 
nal of tiie binary image signal to the first coding 
means and tiie second operation is to supply tiie 
shape signal of the arbitrary shape image signal to 
tiie first coding means while supplying the pixel 
value signal of tiie arbitrary shape image signal to 
tiie second coding means; and 
multiplexing means for multiplexing tfie identifier 
signal from the signal identification means, the 
coded shape bit streams output from tiie first cod- 
ing means, and the coded pixel value bit streams 
output from the second coding means; 
wherein a coded binary signal including tiie Kfenti- 
f ier signal and ttie coded shape bit sti-eams is out- 
put when tiie binary image signal is input as tiie 
digital image signal, and a coded arbitrary shape 
signal including tiie identifier signal, ttie coded 
shape bit streams, and the coded pixel value bit 
streams is output when the arbitrary shape image 
signal is input as the digital image signal. 

Therefore, even though image signals having differ- 
ent data structures are coded by different coding meth- 
ods, these coded signals can be decoded in decoding 
processes corresponding to a single coding mettiod. In 
addition, tiie bit number hardly inaeases during the 
coding process. 

According to a sixtii aspect of tiie present invention. 
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there is provided an image decoding method receiving, 
as a coded signal obtained by coding a digital Image 
signal, a coded Image signal having an image Identifier 
according to the data structure of the digital image sig- 
nal, and subjecting the coded image signal to a decod- 5 
Ing process according to the data structure, wherein: 

the coded Image signal Is analyzed with reference 
to the image identifier to decide whether the coded 
image signal is a coded arbitrary shape signal 
including, as data for display, both of coded shape 
bit streams obtained by coding a shape signal 
which represents the shape of each object as one 
of the components of a display image and coded 
pixel value bit streams ot>tained by coding of a pixel 
value signal representing the gradation of the 
object, or a coded binary signal including, as data 
for display, only coded shape bit streams obtained 
tiy coding a shape signal representing a display 
image of binary information; 
when the input coded image signal is the coded 
arbitrary shape signal, decoding of the coded 
shape bit streams thereof by a first decoding 
method, and decoding of the coded pixel value brt 
streams thereof by a second decoding method, are 
earned out according to the anrangement of these 
bit streanrts; and 

when the input coded image signal is the coded 
binary signal, only decoding of the coded shape bit 
streams tliereof by the first coding method Is car- 
ried out. 

Therefore, even though image signals having differ- 
ent data structures are coded by different coding meth- 
ods, these coded Image signals can be decoded in 
decoding processes con'esponding to a single coding 
method. In addition, the bit number hardly increases 
during the coding process. 

According to a seventh aspect of the present inven- 
tion, in the above-described image decoding method, 
the image identifier comprises a 2-bit code. Therefore, it 
is possible to decode four kinds of coded image signals 
including a coded binary signal and a coded arbitrary 
shape signal, in decoding processes corresponding to a 
single coding method. 

According to an eighth aspect of the present Inven- 
tion, there is provided an Image decoding apparatus 
receiving, as a coded signal obtained by coding a digital 
image signal, a coded image signal having an image 
identifier according to the data structure of the digital 
Image signal, and subjecting the coded Image signal to 
a decoding process according to the data structure, 
comprising: 

data analysis means for deciding whether the 
coded imaige signal is a coded arbitrary shape sig- 
nal including, as data fbr display, both of coded 
shape bit streams obtained by coding a shape sig- 



nal which represents the shape of each object as 
one of the components of a display image and 
coded pixel value bit streams obtained by coding a 
pixel value signal representing the gradation of the 
object, or a coded binary signal including, as data 
fbr display, only coded shape bit streams obtained 
by coding a shape signal representing a display 
image of binary information; 
first decoding means for decoding the coded shape 
bit streams by a first decoding process to generate 
a decoded shape signal; 

second decoding means fbr decoding the coded 
pixel value bit streams by a second decoding proc- 
ess employing a decoding method different from 
that of the first decoding process, thereby generat- 
ing a decoded pixel value signal; 
signal switch means fbr supplying the coded image 
signal to one of the first and second decoding 
means, according to a switch control signal; 
the data analysis means supplying a first switch 
control signal to the signal switch means when the 
coded image signal is the coded binary signal, and 
supplying a second switch control signal to the sig- 
nal switch means when the coded image signal Is 
the coded arbitrary shape signal; and 
the signal switch means being in the fixed switching 
state where the coded shape bit streams of the 
coded binary signal are input to the first decoding 
means alone when it receives the first switch con- 
trol signal, and being in the alternate switching state 
where, according to the arrangement of the coded 
shape bit streams and the coded pixel value bit 
streams in the coded arbitrary shape signal, the 
coded shape bit streams are input to the first 
decoding means while the coded pixel bit streans 
are input to the second deciding means, when it 
receives the second switch control signal. 

Therefore, even though image signals having differ- 
ent data structures are coded k>y different coding meth- 
ods, these coded image signals can be decoded in 
decoding processes corresponding to a single coding 
method. In addition, the bit number hardly increases 
during the coding process. 

According to a ninth aspect of the present inven- 
tion, the above-described image decoding apparatus 
further connprises over-toad detection means fbr detect- 
ing that the load on the decoding process by one of the 
first and second decoding means exceeds a threshold 
value which is set in advance, and outputting an over- 
load detection signal toward the data analysis means: 

wherein, when the over-load detection signal is 
input to the data analysis means, the data analysis 
means outputs a third switch control signal toward 
the signal switch means; and 
in response to the third switch control signal, the 
signal switch means supplies either of the coded 
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shape bit streams and the ooded pixel value bit 
streams in the ooded arbitrary shape signal to one 
of the first and second decoding means. 

Therefore, coded image signals having different 
data structures can be decoded in decoding processes 
oonresponding to a single coding method, and the bit 
number hardly Increases during the coding process. 
Further, even when a processor for decoding is over- 
loaded, the coded image signals are reproduced by the 
decoding processes while maintaining smooth nxytion 
of image on the display screen. 

According to a tenth aspect of the present inven- 
tion, the above-described image decoding apparatus 
further comprises control signal input means for input- 
ting a manual control signal from the outside to the data 
analysis means: 

wherein, when the data analysis means receives 
the manual control means, it outputs a third switch 
control signal toward the signal switch means; and 
in response to the third switch control signal, the 
signal switch means supplies the coded shape bit 
streams of the coded arbitrary shape signal to the 
first decoding means, and does not supply the 
coded pixel value bit streams to the second decod- 
ing means. 

Therefore, coded image signals having different 
data staictures can be decoded in decoding processes 
con'esponding to a single coding method, and the bit 
number hardly increases during the coding process. 
Further, when image data stored in a recording medium 
are retrieved, only decoding of coded shape bit streams 
Is continued until an object Image is fbund, whereby the 
data retrieval is canried out quickly 

According to an eleventh aspect of the present 
invention, there is provided a data structure for transmit- 
ting a coded Image signal obtained by coding a digital 
image signal, including: 

at least one of the following two kinds of coded bit 
streams: coded shape bit streams obtained by cod- 
ing a shape signal which represents a display 
image of binary information or the shape in binary 
format of each object as one of the components of 
a display image, and coded pixel value bit streams 
obtained by coding a pixel value signal representing 
the gradation of the display image or the object; and 
an image klentif ier comprising a multpie-bit code, 
for deciding whether the coded image signal 
includes, as the ooded bit streams, at least the 
coded shape bit streams, or only the coded pixel 
value bit streams; 

wherein the jmage identifier and the coded bit 
streams are arranged so that the image identifier is 
foltowed by the coded bit streams. 



Therefore, by referring to the image identifier, at 
least a coded image signal including ooded shape bit 
streams and a ooded image signal including no coded 
shape bit streams can be identified among various 

5 kinds of coded image signals. 

According to a twelfth aspect of the present inven- 
tion, there is provided an image decoding method 
receiving, as a coded signal obtained by coding a digital 
image signal, a coded image signal having an Image 

10 Identifier according to the data structure of the digital 
image signal, and subjecting the coded image sigral to 
a decoding process according to the data structure, 
wherein: 

IS the coded Image signal is analyzed with reference 
to the image Identifier to decide which of the follow- 
ing three coded signals is the coded image signal; 

a coded arbitrary shape signal including, as 
so data for display both of coded shape bit 

strean^ obtained by coding a shape signal 
which represents the shape of each object as 
one of the components of a display image, and 
coded pixel value bit streams obtained by cod- 
25 ing a pixel value signal representing the grada- 

tion of tiie object, 

a coded pixel value signal including, as data for 
display, only coded pixel value bit streams 
obtained by coding a pixel value signal repre- 
30 senting the gradation of a display image, and 

a coded binary signal including, as data for dis- 
play, only coded shape bit streams obtained by 
coding a shape signal representing a display 
image of binary information; 

35 

when the input coded image signal is tiie coded 
pixel value signal, decoding of the coded pixel value 
bit streams thereof Is earned out; and 
when tiie input coded image signal is ttie coded 
40 binary signal or tiie ooded arbitrary shape signal, 
decoding of the ooded bit streams included in these 
signals Is stopped. 

Therefore, among a coded binary signal, a coded 
45 arbitrary shape signal, and a coded rectangle signal 
(coded pixel value signal), only tiie coded rectangle sig- 
nal can be selected and decoded by a decoding appa- 
ratus for decoding only the coded rectangle signal 
which is obtained by coding a pixel value signal for color 
so display of image. 

According to a thirteentii aspect of tiie present 
invention, there Is provided an image decoding appara- 
tus receiving, as a coded signal obtained by coding a 
digital image signal, a coded Image signal having an 
55 image identifier according to ttie data structure of ttie 
digital image signal, and subjecting the ooded image 
signal to a decoding process according to the data 
structure, comprising: 
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data analysis means for analyzing the coded image 
signal according to the image identifier to decide 
which of the following three coded signals is the 
coded image signal; 

5 

a coded arbitrary shape signal including, as 
data for display, both of coded shape bit 
streams obtained by coding a shape signal 
which represents the shape of each object as 
one of the components of a display image, and io 
coded pixel value bit streams obtained by cod- 
ing a pixel value signal representing the grada- 
tion of the object, 

a coded pixel value signal including, as data for 
display, only coded pixel value bit streams is 
obtoined by coding a pixel value signal repre- 
senting the gradation of a display image, and 
a coded binary signal including, as data for dis- 
play, only coded shape bit streams obtained by 
coding a shape signal repres^ting a display 20 
image of binary information; 

decoding means for decoding the coded pixel value 
bit streams to generate a decoded pixel value sig- 
nal; 25 
signal discarding means fbr discarding the coded 
image signal; 

signal switch means for supplying the coded image 
signal to one of the decoding means and the signal 
discarding means according to a switch control sig- 30 

nal; 

the data analysis means supplying a first switch 
control signal to the signal switch means when the 
coded image signal is the coded pixel value signal, 
and supplying a second witch control signal to the 3S 
signal switch means when the coded image signal 
is the coded arbitrary shape signal or the coded 
binary signal; and 

the signal switch means supplying the coded pixel 
value bit streams of the coded pixel value signal to 40 
the decoding means when it receives the first 
switch control signal, and supplying the coded bit 
streams included in the coded arbitrary shape sig- 
nal and the coded binary signal to the signal dis- 
carding means when it receives the second switch 45 
control signal. 

Therefore, among a coded binary signal, a coded 
arbitrary shape signal, and a coded rectangle signal 
(coded pixel value signal), only the coded rectangle sig- so 
nal can be selected and decoded by a decoding appa- 
ratus for decoding only the coded rectangle signal 
which is obtained by coding a pixel value signal for color 
display of image. 

According to a fourteenth aspect of the present 55 
invention, there is provided a data structure fbr transmit- 
ting a coded image signal obtained by coding a digital 
image signal, including: 



at least one of the following three kinds of coded bit 
streams: coded shape bit streams ot>tained by cod- 
ing a shape signal which represents a display 
Image of binary information or the shape in binary 
fonnat of each object as one of the components of 
a display image; coded pixel value bit streams 
obtained by coding a pixel value signal representing 
the gradation of the display image or the object; and 
coded transparency bit streams oblained by coding 
a nultivalued transparency signal representing the 
transparency of the object; and 
an image identifier compr^ing a multiple-bit code, 
for deciding which of the following tour coded image 
signals is the coded image signal; 

a coded pixel value signal including, as the 
coded bit streams, only the coded pixel value 
bit streams, 

a first coded arbitrary shape signal including, 
as the coded bit streams, the coded shape bit 
streams and the coded pixel value bit streams, 
a coded binary signal including, as the coded 
bit streams, only tiie coded shape bit streams, 
and 

a second coded arbitrary shape signal includ- 
ing, as the coded bit streams, the coded shape 
bit streams, the coded pixel value bit streams, 
and the coded transparency bit streams; 

wherein the image identifier and the coded bit 
streams are arranged so that the image identifier is 
followed by the coded bit streams. 

Therefore, by referring to the image identifier, 
among various kinds of coded image signals, a coded 
image signal Including at least one of coded shape bit 
streams, coded pixel value bit streams, and coded 
transparency bit streams can be identified. 

According to a fifteenth aspect of the present inven- 
tion, tiiere is provkied an image decoding method 
receiving, as a coded signal obtained by coding a digital 
Image signal, a coded image signal having an image 
Identifier according to the data structure of the digital 
Image signal, and subjecting the coded image signal to 
a decoding process according to tiie data structure, 
wherein: 

tiie coded image signal Is analyzed with reference 
to tiie image identifier to decide which of the follow- 
ing lour coded signals is the coded image signal; 

a first coded arbitrary shape signal including, 
as data for display, coded shape bit streams 
obtained by coding a shape signal representing 
the shape of each object as one of the compo- 
nents of a display image, and coded pixel value 
bit streams obtained by coding a pixel value 
signal representing the gradation of tiie ot^ect. 
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a second ooded arbitrary shape signal indud- 
ing. as data for display, in addition to coded 
shape bit streans and ooded pixel value bit 
streams, coded transparency bit streams 
obtained by coding a multivalued transparency 5 
signal representing the transparency of the 
object, 

a coded pixel value signal including, as data for 
display, only ooded pixel value bit streams 
obtained by coding a pixel value signal repre- 10 
senting the gradation of a display image, and 
a coded binary signal including, as data for dis- 
play, only coded shape bit streams obtained by 
coding a shape signal representing a display 
image of binary information: is 

when the input coded image signal is the first coded 
arbitrary shape signal, decoding of the coded 
shape bit streams thereof by a first decoding 
method, and decoding of the coded pixel value bit 20 
streams thereof by a second decoding method, are 
carried out according to the arrangement of these 
bit streams; 

when the input coded image signal is the second 
coded arbitrary shape signal, decoding of the 25 
coded shape bit streams thereof by the first decod- 
ing method, decoding of the coded pixel value bit 
streams thereof by the second decoding method, 
and decoding of the coded transparency bit 
streams thereof by a third decoding method, are so 
carried out according to the arrangement of tiiese 
bit streams; 

when the input coded image signal is the coded 
pixel value signal, only decoding of the coded pixel 
value bit streams thereof by the second decoding 3s 
method is carried out; and 
when the input coded image signal is the coded 
binary signal, only decoding of the coded shape bit 
streams thereof by the first decoding method is car- 
ried out. 40 

Therefore, for example, the first and second coded 
artxtrary shape signal, the coded rectangle signal 
(coded pixel value signaQ. and the coded binary signal 
can be decoded by the f nrst to tiiird decoding methods 4S 
corresponding to three coded bit streams included In 
the second coded arbitrary shape signal. 

According to a sixteenth aspect of the present 
invention, there is provided a data structure for transmit- 
ting a coded image signal obtained by coding a digital bo 
image signal, including: 

at least one of the following three kinds of coded bit 
streams: coded shape bit streams obtained by cod- 
ing a shape signal which represents a display 55 
image of binary information or the shape in binary 
fbrmat of each object as one of the components of 
a display image, coded pixel value bit streams 



obtained by coding a pixel value signal representing 
the gradation of the display Image or tiie object, and 
ooded transparency bit streams obtained by coding 
a multivalued transparency signal representing the 
transparency of the object; and 
an image identifier corrprising a multiple-bit code, 
for deciding which of tiie following five coded image 
signals is the coded Image signal; 

a coded pixel value signal inducfing. as tiie 
coded bit streams, only ttie coded pixel value 
bit streams, 

a first coded arbitrary shape signal induding, 
as the coded bit streams, the coded shape bit 
streanrts and the coded pixel value bit streams, 
a coded binary signal induding, as the coded 
bit strearDS. only the coded shape bit streams, 
a second coded arbitrary shape signal indud- 
ing, as the coded bit streams, the coded shape 
bit streams, tiie coded pixel value bit streams, 
and the coded transparency bit streams, and 
a coded transparency signal induding, as tiie 
coded bit streams, the coded shape bit streams 
and the coded transparency bit streams; 

wherein tiie image identifier and the coded bit 
streams are arranged so that the image identifier is 
followed by tiie ooded bit streams. 



Therefbre. by refen-ing to the image identifier. 
anx)ng various kinds of coded image signals, a coded 
image signal including at least one of coded shape bit 
streams, coded pixel value bit streams, and coded 
transparency bit streams can be identified. 

According to a seventeenth aspect of tiie present 
invention, there is provided an image decoding method 
receiving, as a coded signal obtained by coding a digital 
image signal, a coded image signal having an image 
identifier according to tiie data structure of tiie digital 
image signal, and subjecting the coded image signal to 
a decoding process according to tiie data structure, 
wherein: 

tiie coded image signal is analyzed witii reference 
to tiie image identifier to dedde which of the fbltow- 
Ing five coded signals is tiie ooded image signal; 

a first coded arbitrary shape signal including, 
as data for display, coded shape bit streams 
obtained by coding a shape signal representing 
the shape of each object as one of the compo- 
nents of a display image, and ooded pixel value 
bit streams obtained by coding a pixel value 
signal representing tiie gradation of the object, 
a second coded arbitrary shape signal indud- 
ing. as data for display, in addition to coded 
shape bit streams and coded pixel value bit 
streams, coded transparency bit streams 
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obtained by coding a multivalued transparency 
signal representing the transparency of the 
okject. 

a coded transparency signal including, as data 
for display, coded shape bit streams obtained s 
by coding a shape signal representing the 
shape of the object, and coded transparency 
bit stream obtained by coding a multivalued 
signal representing the transparency of the 
object. 10 
a coded binary signal including, as data for dis- 
play, only coded shape bit streams obtained by 
coding a shape signal representing a display 
image of binary Information, and 
a coded pixel value signal including, as data for is 
display, only coded pixel value bit streams 
obtained by coding a pixel value signal repre- 
senting the gradation of a display Image; and 

when the input coded image signal is the first coded so 
arbitrary shape signal, decoding of the coded 
shape bit streams thereof by a first decoding 
nrtethod. and decoding of tiie coded pixel value bit 
streams thereof by a second decoding method, are 
canried out according to the anrangement of tiiese ss 
bit streams; 

when tine input coded image signal is tiie second 
coded arbitrary shape signal, decoding of the 
coded shape bit streams thereof by the first decod- 
ing method, decoding of the coded pixel value bit 30 
streams thereof by tiie second decoding method, 
and decoding of tiie coded transparency bit 
streams ttiereof by a third decoding metiiod. are 
carried out according to the arrangement of these 
bit streams; 3S 
when tiie Input coded image signal is tiie coded 
transparency signal, decoding of the coded shape 
bit streams thereof by the first decoding method, 
and decoding of tiie coded transparency bit 
streams by the third decoding mettiod, are carried 40 
out according to tiie arrangement of these bit 
streams; 

when ttie input coded image signal is tiie coded 
binary signal, only decoding of tiie coded shape bit 
streams tiiereof 1:^ the first decoding method is car- 45 
ried out; and 

when the input coded image signal is tiie coded 
pixel value signal, only decoding of the coded pixel 
value bit streams tiiereof by tiie second decoding 
method is carried out. so 

Therefore, for example, the coded arbitrary shape 
signal, tiie coded rectangle signal (coded pixel value 
signal), tiie coded binary signal, and tiie coded trans- 
parency signal can be decoded by the first to ttiird 55 
decoding methods corresponding to three coded bit 
streams included in tiie coded arbitrary shape signal 
witti transparency infonnation. 



According to an eighteentii aspect of tiie present 
invention, tiiere is provided a data storage medium con- 
taining a program for implementing a decoding process 
of a coded image signal by a computer, ttie program 
being constructed so that a decoding process according 
to any of the above-descrit>ed image decoding methods 
is executed by the computer TTierefore, when the pro- 
gram is loaded into tiie computer, tiie decoding process 
according to ttie above^lescribed decoding method can 
be implemented by software. 

According to a nineteentii aspect of the present 
invention, tiiere is provided a data storage medium con- 
taining a coded image signal obtained by coding a dig- 
ital image signal, the coded image signal having any of 
tiie above-described data structures for Image transmis- 
sion. Therefore, when tiie stored coded image signals 
are read from the medium and decoded, these coded 
image signals, having different data structures, can be 
identified. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Rgures 1(a) and 1(b) are diagrams showing a data 
structure of a coded arbitrary s^e signal and a 
data structure of a coded binary signal, respec- 
tively, as data structures for image f ansmission 
according to a first embodiment of tiie invention. 
Rgures 2(a) and 2(b) are diagrams showing a data 
structure of a coded arbitrary shape signal and a 
data structure of a coded binary signal, respec- 
tively, as data structures for image ti'ansmlsslon 
according to a modification of tiie first embodiment. 
Rgure 3 is a tHock diagram illustrating an image 
coding apparatus according to a second embodi- 
ment of the invention. 

Rgure 4 is a flowchart for explaining a coding proc- 
ess by the image coding apparatus according to ttie 
second embodiment 

Rgure 5 is a block diagram Illustrating an image 
decoding apparatus according to a tiiird embodi- 
ment of the invention. 

Rgure 6 is a flowchart for explaining a decoding 
process by the image decoding apparatus accord- 
ing to tiie tiiird embodiment 
Rgure 7(a) is a blodc diagram showing an image 
input unit included in tiie Image coding apparatus 
according to the second enfoodiment, and figure 
7(b) is a block diagram showing a data analyzer 
included in the image decoding apparatus accord- 
ing to tiie tiiird embodiment 
Rgure 8 is a block diagram illustrating an image 
decoding apparatus according to a fourth embodi- 
ment of the invention. 

Rgure 9 is a block diagram illustrating an image 
decoding apparatus according to the fifth embodi- 
ment of the invention. 

Rgures 10(a), 10(b), and 10(c) are diagrams show- 
ing data structures of a coded arbitrary shape sig- 
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nal, a coded binary signal, and a coded rectangle 
signal, respectively, as data structures for intage 
transnrtission according to a sixth embodiment of 
the invention. 

Figure 11 is a block diagram illustrating an image 
decoding apparatus according to a seventh embod- 
iment of the invention. 

Figure 12 is a flowchart for explaining a decoding 
process by the image decoding apparatus accord- 
ing to the seventh embodiment. 
Figures 13(a) and 13(b) are diagrams illustrating a 
data structure of a coded arbitrary shape signal and 
a data structure of a coded binary signal, respec- 
tively as data structures for image transmission 
according to an eighth embodiment of the inven- 
tion. 

Figures 14(a) and 14(b) are diagrams illustrating a 
data structure of a coded rectangle signal and a 
data structure of a coded arbitrary shape signal 
with transparency information, respectively, as data 
structures for image transmission according to the 
eighth emt)0diment. 

Figure 15 is a block diagram illustrating an image 
decoding apparatus according to a ninth embodi- 
ment of the invention. 

Figure 16 is a flowchart for explaining a decoding 
process by the image decoding apparatus accord- 
ing to the ninth embodiment. 
Figures 17(a). 17(b). and 17(c) are data structures 
of a coded arbitrary shape signal, a coded binary 
signal, and a coded rectangle signal, respectively, 
as data structures for Image transmission accord- 
ing to a tenth embodiment of the invention. 
Figures 18(a) and 18(b) are diagrams showing a 
data structure of a coded art)itrary shape signal 
with transparency information and a data structure 
of a coded transparency signal, respectively, as 
data stoictures for image transmission according to 
the tenth emkx)diment. 

Figure 19 is a block diagram illustrating an image 
decoding apparatus according to an eleventh 
enrtediment of the invention. Rgure 20 is a flow- 
chart for explaining a decoding process 
by the image decoding apparatus according to the 
eleventh embodiment. 

Figures 21(a)-21(c) are diagrams for explaining a 
data storage medium (figures 21(a),21(b)) which 
contains a program for implementing an image cod- 
ing apparatus or an image decoding apparatus 
according to any of the aforementioned embodi- 
ments, using a computer system (figure 21(c)). 
Figures 22(a)-22(c) are diagrams fbr explaining a 
communication system using the JBIG type data 
compressive coding process and, nrore specifically 
figures 22(a) and 22(b) show an image coding 
apparatus and an image decoding apparatus 
included in the system, respectivety, and figure 
22(c) shows a data structure of a coded image sig- 



nal adopted in the system. 
Figures 22(a)-22(c) are diagrams for explaining a 
communication system using a data corrpressive 
coding process based on JBIG, more specifically, 

5 figures 22(a) and 22(b) show an image coding 
apparatus and an image decoding apparatus 
included in the system, respectively, and figure 
22(c) shows a data structure of a coded image sig- 
nal adopted in the system. 

10 Rgures 23(a)-23 (c) are diagrams for explaining a 
communication system using a data compressive 
coding process t>ased on MPEG2. more specifi- 
cally, figures 23(a) and 23(b) show an image coding 
apparatus and an image decoding apparatus 

15 included in the system, respectively, and figure 
23(c) shows a data structure of a coded image sig- 
nal adopted in the system. 
Rgures 24(a)-24(c) are diagrams for explaining a 
oommunfoation system using a data conrpressive 

20 coding process based on MPEG4, more specifi- 
cally figures 24(a) and 24(b) show an image coding 
apparatus and an image decoding apparatus 
included in the system, respectivety and figure 
24(c) shows a data structure of a coded image sig- 

25 nal adopted in the system. 

DETAILED DESCRIPTION OF THE PREFERRED 
SMBQPIMENTS 

30 [Embodiment 1] 

Rgures 1(a) and 1(b) are diagrams illustrating data 
structures for image transmission according to a first 
embodiment of the present invention. Figure 1 (a) shows 

35 a data structure of a coded arbitrary shape signal 
obtained by coding an arbitrary shape Image signal cor- 
responding to each of plural objects constituting a dis- 
play image. The data structure for image transmission 
according to the first embodiment is applied to a coding 

40 and decoding system in which an arbitrary shape image 
signal is compressively coded and transmitted and, fur- 
ther, the coded signal is decoded and displayed. That is. 
in this system, the Image coding method and apparatus 
are basically constructed to perform a coding process 

45 for the arbitrary shape image signal while the image 
decoding method and apparatus are basically con- 
structed to perform a decoding process for the coded 
arbitrary shape signal. 

In figure 1(a). reference numeral 500 designates a 

50 coded arbitrary shape signal obtained by coding an 
arbitrary shape image signal corresponding to each of 
plural objects constituting an image of one display 
image. The coded arbitrary shape signal 500 includes a 
32-bit synchronous signal 501 at the beginning, a 1-bit 

55 shape identifier (image identifier) 502 that follows the 
signal 501, and an additional header 503 that follows 
the identifier 502. In the figure, the shape kientifier 502 
is represented as "SID". 
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Further, the coded arbitrary shape sigr^l 500 
includes coded shape bit streams 51 A which are 
obtained by coding a shape signal that represents the 
shape of each otiject as a constituent of the art»trary 
shape image signal, and coded texture bit streams s 
(coded pixel value bit streams) 52A which are obtained 
by coding a texture signal ^ixel value signal) that com- 
prises a luminance signal and a color difference signal 
for color display of each object as a constituent of the 
arbitrary shape image agnal. To be specific, In the w 
coded arbitrary shape signal 500, for each of blocks into 
which an object region including an object on a di^lay 
image Is divided, a coded shape bit stream 51a and a 
coded texture bit stream 52A are ananged in this order. 

More specifically, following the header 503. is 
arranged are a coded shape bit stream 51 A1 and a 
coded texture bit stream 52A1 corresponding to a block 
A1 , a coded shape bit stream 51 A2 and a coded texture 
bit stream 52A2 corresponding to a block A2. and a 
coded shape bit stream 51 A3 and a coded texture bit 20 
stream 52A3 conesponding to a block A3. 

Further, the coded shape bit streams 51 A1. 51 A2. 
and 51 A3 comprise variable-length coded data 504. 
509, and 51 4 conesponding to shape motion vectors (in 
figure 1(a), "shape MNT); and variable-length coded ss 
data 505, 510, and 515 corresponding to binary shape 
signals, each representing whether pixels within the 
block are located inside the olsject or outside the object 
(in the figure, "ishape data"), respectively. 

TTie coded texture bit streams 52A1. 52A2. and so 
52A3 comprise 5-bit coded data 506. 51 1 . and 51 6 cor- 
responding the quantization scales (in figure 1(a), 
"quantization scale"), variable-length coded data 507, 
512, and 517 corresponding to texture motion vectors 
(In the figure, texture MVT); and variable-length coded 3S 
data 508, 513, and 518 con'esponding to quantized sig- 
nals obtained by subjecting the texture signal to OCT 
and quantization (in the figure, texture DCT coeffi- 
cients"), respectively 

The synchronous signal 501 is a signal indicating 40 
the head of a coded arbitrary shape signal correspond- 
ing to one object, and this is a unique coded signal. The 
shape identifier (SID) 502 is a signal indicating whether 
or not both of coded shape bit streams and coded tex- 
ture bit streams are included in the coded image signal. 45 
When the value of the shape identifier (SID) is 0. it indi- 
cates that tx)th of the coded shape bit streams arxJ the 
coded texture bit streams exist in the coded image sig- 
nal. When SID s 1. the shape identifier indicates that 
only the coded shape bit streams exist in the coded sig- so 
nal. Therefore, in the data structure of figure 1(a), the 
shape identifier (SID) 502 is 0. The header 503 includes 
information relating to, for example, the time to display 
the image of the corresponding object, the attribute of 
the Image, and the prediction mode for coding. How- 55 
ever, these data have no relationship with the present 
Invention and, therefore, do not require detailed descrip- 
tion. 



The shape MV is the coded data of a motion vector 
which represents a motion of an image within a block 
between the present frame and the previous frame, and 
this is used for prediction of a shape signal of a specific 
block in the present frame from a shape signal of the 
corresponding block in the previous frame. Further, the 
shape data is obtained by subjecting a shape signal to 
arithmetic coding, and the quantization scale is a 
parameter for inversely quantizing DCT coefficients 
which are obtained by subjecting a texture signal to 
DCT and quantization. The texture MV is the coded 
data of a texture motion vector which represents a 
motion of an in^ge within a block between the present 
frame and the previous frame, arxJ this is used for pre- 
diction of a texture signal in the preserrt frame from a 
texture signal in the previous frame. Further, the texture 
DCT coefficients are obtained by subjecting the quan- 
tized texture signal to variable-length coding. 

In the coded arbitrary shape signal 500, actually, 
many pieces of side information (data) are arranged 
before the texture DCT coefficients althcajgh these data 
are not shown in the figure, and these side data some- 
times require a large numl^er of bits. 

Rgure 1(b) shows a data structure of a coded 
binary signal obtained by coding a binary image signal. 
In figure 1(b). reference numeral 600 designates a 
coded binary signal obtained by coding a binary image 
signal S2 that represents image information as a binary 
signal on one display image. The coded binary signal 
600 includes a 32-bit synchronous signal 601 at ttie 
beginning, a 1-bit shape identifier (image identifier) 602 
that follows the synchronous signal 601, and an addi- 
tional header 603 tiiat follows tiie shape identifier 602. 
Further, the coded binary signal 600 includes coded 
shape bit streams 61 B obtained by coding shape sig- 
nals constituting the binary image signal S2. In figure 
1(b), the shape identifier is shown as SID. 

To be specffk:, in the coded binary shape signal 
600. tiie coded shape bit streams 61 B are successively 
arranged correspondingly to the respective blocks Into 
which ttie display image is divided. More specifically, 
coded shape bit streams 61 B1, 61 B2. 61 B3. 61 B4, 
61 B5, ... respectively corresponding to the Nocks B1, 
B2, B3, B4, B5, ... are anranged in this order. 

Further, tiie coded shape bit streams 61B1~61B5 
comprise variable-lengtii coded data 604, 606, 608, 
610, and 612 corresponding to shape nfK>tion vectors (in 
tiie figure, "shape MV"), and variable-lengtii coded data 
605, 607. 609, 611, and 613 con-esponding to shape 
signals representing the image on the display image by 
binary signals (in the figure, "shape data"), respectively 

The synchronous signal 601, the shape identifier 
(SID) 602, and the header 603 are identical to ttie syn- 
chronous signal 501 . tiie shape identifier (SID) 502, and 
ttie header 503 in ttie coded arisitrary shape signal 500, 
respectively, and ttie data of ttie blocks B1~B5 ... are 
only the coded shape tXi streams. Since the coded 
binary signal 600 includes no coded texture bit streams, 
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the shape identifier (SID) 602 is 1 . 

In this first embodiment, the shape Identifier (SID) 
502 In the coded arbitrary shape signal 500 and the 
shape identifier 602 in the coded binary signal 600 are 
disposed, for each frame, in the coded signals 500 and s 
600, respectively 

As shown in figures 1 (a) and 1 (b), the bit number of 
the coded data of the shape signal or the texture signal 
is variable because the bit number required for coding 
varies according to the image included in the display 
image or in the block of the display image. Therefore, it 
is impossible to predict the position of the quantization 
scale 506. i.e., how many bits exist between the head of 
the shape data 505 and the quantization scale 506. Fur- 
ther, whether the coded texture bit stream 52A is posi- 
tioned after the coded shape bit stream 51 A or not 
cannot be decided without the shape identifier 502. 
Therefore, when coding and transmitting the shape sig- 
nal without the shape identifier, it is necessary to insert 
a dummy coded texture bit stream between the coded 
shape bit streams of the adjacent blocks, but the inser- 
tion of the dummy coded texture bit stream increases 
the bit number when the shape signal is coded. By the 
way. instead of disposing at the header of each image, 
a shape identifier may be disposed at the head of the 
whole image sequence, or it may be disposed for a plu- 
rality of images. 

In MPEG4, besides the artxtrary shape Image sig- 
nal and the binary image signal, transparency informa- 
tion representing the transparency of each pixel can be 
processed. Such transparency information is usually 
expressed by a signal of 3 bits or more, and it is separa- 
ble into a binary signal as shape information (binary 
transparency signal) and a multivalued transparency 
signal representing the transparency information 
excluding the shape information. In this case, the multi- 
valued transparency signal can be treated in the same 
manner as a texture signal. 

Hereinafter, a desaiption is given of a process of 
coding a shape signal and a texture signal, which sig- 
nals are components of an aibitrary shape image sig- 
nal. 

Initially, with respect to a shape signal, an object 
region Including an object on the display image is 
divided into plural blocks (shape blocks), and the shape 
signal is coded block by block. In this first embodiment, 
each shape bfock is a display region comprising 16x16 
samples (pixels), and a shape signal conesponding to 
each shape block Is coded by tiie arithmetic coding 
method employed in JBIG. 

With respect to a texture signal, as described 
above, an object region including an object on the dis- 
play image is divided into plural blocks (texture blocks), 
and the texture signal is compressively coded block by 
block. In this first embodiment, each texture block is a 
display region comprising 16x16 samples (pixels). In 
the compressive coding process, DCT and quantization 
are earned out as fdfows. The texture bfock is divkied 



into four display regions (sub-blocks) each comprising 8 
x8 samples (pixels), and the texture signal is subjected 
to DCT and quantization, sub^ock by sub-block. Then, 
quantized signals provkled by the above-described 
process are si^ected to variable-length coding to gen- 
erate coded texture bit streams. 

The coded shape bit streams and the coded texture 
bit streams so generated are multiplexed together with 
other required signals, thereby creating a coded arbi- 
trary shape signal 500 having a data structure shown in 
figure 1(a). 

Further, a process of coding a shape signal as a 
constituent of a binary image signal in JBIQ Is almost 
identical to tiie above-described shape signal coding 
method employed for MPEQ4. 

That is, a display image is divided into plural blocks 
(shape blocks), and the shape signal is coded block K>y 
block, tiiereby creating a coded binary signal 600 hav- 
ing a data stmcture shown In figure 1(b). In this first 
enfoodlment, tiie shape block is a display region com- 
prising 16x16 sanples (pixels). A shape signal corre- 
sponding to each shape block is coded using the 
arittimetic coding method employed in JBIQ. 

As desaibed above, in tiie first embodiment of the 
invention, the coded binary signal corresponding to a 
binary image signal includes ttie coded shape bit 
streams 61 B obtained by coding tiie shape signal ttiat 
represents the display image of binary information, and 
the shape klentifier 602 indicating that only the coded 
shape bit streams are Included as display data, it is pos- 
sible to analyze a coded binary signal including no 
coded texture bit streams, by referring to tiie image 
identifier, using a data analysis method adapted to a 
coded signal including coded texture bit streams. 

To be speciffo, using a data analysis method for 
analyzing a coded signal of an ari3itrary shape image 
signal (coded aititrary shape signal) including botii of a 
shape signal and a texture signal (pixel value signal), a 
coded signal of a binary image signal including only a 
shape signal as display information (coded binary sig- 
nal) can be analyzed. Ther^re, even tiiough a dummy 
coded pixel value bit stream Is not added to each coded 
shape bit stream when coding the binary image signal, 
the coded shape bit stream of the binary signal can be 
decoded by the decoding process based on MPEQ4. 
That is. without increasing tiie number of bits in the cod- 
ing process, both the binary image signal and the arbi- 
trary shape image signal can be decoded by an image 
decoding apparatus adapted to a single coding metiiod. 

As desaibed above, the first embodiment of the 
invention empfoys. as a coded arbitrary shape signal 
and a coded binary signal, tiie coded arbitrary shape 
signal 500 and the coded binary signal 600 which are 
obtained by inter-frame predictive coding, respectively 
It is needless to say that a coded arbitrary shape signal 
provfoed by intra-frame coding has a data structure 
excluding ttie shape MVs and texture MVs from ttie 
coded arbitrary shape signal 500 while a coded binary 
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signal provided by intra-frame coding has a data struc- 
ture excluding the shape MVs from the coded binary 
signal 600. 

Further, the first embodlnient of the invention 
employs, as a coded arbitrary shape signal and a coded 
binary signal, the coded arbitrary shape signal 500 in 
which a coded shape bit stream and a coded texture bit 
stream are arranged for each blocK and the coded 
binary signal 600 in which a coded shape bit stream is 
arranged for each block, respectively. However, a coded 
signal having a data structure for Image transmission 
according to the invention is not restricted to those 
shown in figures 1(a) and 1 (b). 

For example, a coded arbitrary shape signal 500b 
having a data structure shown in figure 2(a) may be 
employed, which data structure comprises, for eadi 
frame, a synchronous signal 501, a shape identifier 
(SID) 502, an additional header 503, a shape data part 
51 , and a texture data part 52. Further, a coded binary 
signal 600b having a data structure shown in figure 2(b) 
may be employed, which data structure comprises, for 
each frame, a synchronous signal 601 , a shape identi- 
fier (SID) 602, an additional header 603. and a shape 
data part 61. 

The shape data part 51 is obtained by collecting, for 
one frame, the coded shape bit streams corresponding 
to the respective blocks in the coded arbitrary shape 
signal as shown in figure 1 (a). The texture data part 52 
is obtained by collecting, for one frame, the coded tex- 
ture bit streams con^esponding to the respective blocks 
in the coded arbitrary shape signal shown in figure 1 (a). 
Further, the shape data part 61 is obtained by collect- 
ing, for one frame, the coded shape bit streams corre- 
sponding to the respective blocks in the coded binary 
signal shown in figure 1(b). 

[Embodiment 2] 

Figure 3 is a block diagram illustrating an image 
coding apparatus according to a second emtxxfiment of 
the present invention. In figure 3, reference numeral 
100a designates an image coding apparatus which cre- 
ates a coded image signal having a data structure for 
image transmission according to the first embodiment of 
the invention. This apparatus 1 00a is constructed as fol- 
lows. When the apparatus 100a receives, as an input 
image signal Sin. a binary image signal S2 for display- 
ing a binary image, from a scanner of a facsimile 
machine, it outputs a coded binary signal (E2) 600 
shown in figure 1 (b) as a coded image signal Eo. On the 
other hand, when tiie apparatus 100a receives, as an 
input image signal Sin, a digital image signal Sp from a 
video camera or an image reproduction apparatus. It 
outputs a coded arbitrary shape signal (Ep) 500 shown 
in figure 1(a) as a coded image signal Eo for each 
object 

The image coding apparatus 100a comprises an 
image input unit 1 10 which subjects the input image sig- 



nal Sin to a pre^xxling process to generate a binary 
shape signal and a texture signal, and outputs a switch 
control signal SWIa; a shape coding unit (first coding 
means) 1 20 which sutsjects the shape signal to an arrth- 

5 metic coding process; a texture coding unit (second 
coding means) 130 which subjects the texture signal to 
a coding process including DCT; a switch 101a which 
supplies the output from the image input unit 1 10 to one 
of the coding units 120 and 130. according to the switch 

10 control signal SV\ta; and a frame memory bank 102 
which stores a predictton shape signal and a prediction 
texture signal. 

The image input unit 1 10 Is constructed as fdlows. 
The image input unit 110 distinguishes between a 

15 binary image signal from a scanner or the like and a dig- 
ital video signal from a camera or an image record- 
ing/ireproduction unit (VTR), and the binary Image 
signal is subjected to thresholding to generate a shape 
signal while the digital video signal is subjected to a 

20 chromakey process to generate a texture signal. In the 
chromakey process, an arbitrary shape image signal 
corresponding to each object of a display Image is sep- 
arated from an Image signal of a bad^ound image. 
The arbitrary shape image signal separated is proc- 

25 essed to generate a shape signal representing the 
shape of the object, and a texture signal for gradation 
color display of the image and comprising a luminance 
signal and a color difference signal. Further, the image 
input unit 1 10 outputs an identifier signal (image identi- 

30 fler) Sdis that indicates which signal is processed 
between the binary image signal and the arbitrary 
shape image signal. 

To be specific, as shown in figure 7(a). the image 
input unit 1 1 0 comprises an Identification unit 1 1 1 which 

35 deckJes whether the digital Image input Sin is a binary 
image signal or an artxtrary shape image signal, and 
separates this signal; a thresholding unit 1 1 2 which sub- 
jects the binary image signal to thresholding for each of 
blocks which divKle the display image, thereby creates a 

40 binary shape signal; a chromakey unit 1 13 which sub- 
jects the art3itrary shape image signal to the chromakey 
process for each object region corresponding to each 
object on the display image, thereby generates a binary 
shape signal and a multivalued texture signal, and out- 

45 puts a timing signal T at the end of the processing for 
the texture signal; and a switch control drcu'rt 1 1 4 which 
controls the switch 101a by the switch control signal 
SWa, on the b&SAs of the identifier signal Sdis from the 
identification unit 1 1 1 and the timing signal T from the 

so chromakey unit 1 1 3. 

The shape coding unit 120 comprises a shape 
motion detector 121 which receives the shape signal 
S2k conresponding to the binary image or the shape sig- 
nal Spk corresponding to the arbitrary shape image, 

55 and generates a shape motion vector Skv by block 
matching or the like, for each block, while referring to a 
shape signal of a frame prevtous to the present frame 
which is being processed; and a shape motton oonpen- 
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sator 123 which transforms the shape motion vector 
Skv to an address of the frame memory bank 1 02a. and 
obtains a prediction shape signal Ekm from the frame 
memory bank 102a, based on the address. Further, the 
shape coding unit 1 20 comprises an arithmetic encoder 5 
122 which codes the shape signal Sk from the switch 
101a. block by blocK by an arithmetic coding process 
using the prediction shape signal Ekm, thereby generat- 
ing a coded shape bit stream Ek corresponding to each 
block; and an artthmetc decoder 124 which decodes 
the coded shape bit stream Ek by an arithmetic decod- 
ing process using the prediction shape signal Ekm. The 
output Ekd from the arrthmetto decoder 124 is stored in 
the frame memory bank 102a. 

The texture coding unit 130 comprises a texture 
motion detector 131 which receives the texture signal 
Spt, and generates a texture motk>n vector Stv by block 
matching or the like, for each blocK while referring to a 
texture signal of a frame previous to the present frame 
which is being processed; and a texture motion com- 
pensator 132 which transforms the texture motion vec- 
tor Stv to an address of the frame memory bank 102a. 
and obtains a prediction texture signal Epm from the 
frame memory bank 102a, based on the address. Fur- 
ther, the texture coding unit 130 comprises a first adder 
133 which adds the texture signal Spt and the prediction 
texture signal Epm; a cosine transformer 134 which 
subjects the output Sadi from the adder 133 to block- 
by-block OCX thereby generating DCT coefficients 
Edct; and a quantizer 1 35 which 8ul)jects the DCT coef- 
ficients Edct to block-by-block quantization. 

Furthermore, the texture coding unit 130 comprises 
a variable-length encoder 139 which performs the out- 
put Eq from the quantizer 135 to block-by-block varia- 
ble-length coding, thereby generating a coded texture 
bit stream Ep corresponding to each block; an inverse 
quantizer 136 which performs the output Eq from the 
quantizer 1 35 to inverse quantization; an inverse cosine 
transformer 137 which subjects the output Eiq from the 
inverse quantizer 136 to inverse DCT; and a second 
adder 138 which adds the output Eidct from the inverse 
cosine transfomner 137 and the prediction texture signal 
Epm. The output Sad2 from the second adder 138 is 
stored in the frame memory bank 102a as a prediction 
texture signal. 

The image coding apparatus 100a further includes 
a muftiplexBr 150 whk:h multiplexes the shape identifier 
Sdis from the image input unit 110, the shape motion 
vector Skv and the coded shape bit stream Ek from the 
shape coding unit 120. and the texture motion vector 
Stv and ttie coded texture bit stream Ept from the tex- 
ture coding unit 130. together with other necessary 
data. The multiplexer 150 is constructed as follows. 
When the binary inrnge signal S2 is input, the multi- 
plexer 150 multiplexes the shape Identifier Sdis and the 
coded shape bit stream from the shape coding unit 120. 
together with other necessary data, and outputs tiie 
coded binary signal (E2) 600 shown in figure 1(b). 



When the arbitrary shape image signal Sp is input, the 
multiplexer 150 multiplexes the shape identifier Sdis. 
ttie coded shape bit stream from the shape coding unit 
120, and the coded texture bit stream from the texture 
coding unit 130, togeflier witti oflier necessary data, 
and outputs the coded arbitrary shape signal (Ep) 500 
shown in figure 1(a). 

A description is given of the operation of tiie image 
coding apparatus 100a. 

Rgure 4 is a flowchart showing the coding process 
by the image coding apparatus according to the second 
embodiment of the invention. 

When a digital image input Sin is input to the image 
coding apparatus 100a (Step Sa1), ttie image input unit 
110 decides whettier the digital image input Sin is a 
binary image signal including only a shape signal and 
output from a scanner, or a digital video signal including 
botii of a shape signal and a texture signal and output 
from a camera or an image recording/reproduction 
apparatus (VTR) (Step Sa2). 

When the digital image input Sin is a binary image 
signal, the image input unit 110 generates, as a shape 
identifier (SID), a 1-bit identifier signal of which value is 
"r (Step Sa3) and extracts a binary shape signal S2k 
by ttiresholding of tiie digital image input Sin. At ttiis 
time, the switch 101a is controlled by the switch control 
signal SWa so ttiat ttie shape signal S2k is input to ttie 
shape coding unit 120, and the shape coding unit 120 
performs arittimetic coding of the shape signal S2k 
(StepSa4). 

That is, in the shape coding unit 120. ttie shape 
nfK>tion detector 121 generates a shape motion vector 
Skv from the shape signal S2k for each block. To be 
specific ttie shape signal of ttie present frame, which is 
currentiy processed, is compared with the shape signal 
of ttie previous frame by block matching, thereby detect- 
ing a motion of image between the present frame and 
tiie previous frame, and tiie motion information is pro- 
vkjed as the motion vector Skv. This motion detection is 
described in more detail in. for example. USP (United 
States Patent) No. 4897720. When ttie shape motion 
vector Skv is input to the shape motion compensator 
123, the compensator 123 transforms ttie shape motion 
vector Skv to an address of tiie frame memory bank 
102a, and fetches a prediction shape signal Ekm from 
tiie frame memory bank 1 02a. according to the address. 
When the prediction shape signal Ekm and ttie shape 
signal S2kfrom the image input unit 1 10 are input to the 
arittimetic encoder 122, the arittimetic encoder 122 
8ut)jects ttie shape signal S2k to an arittimetic coding 
process t>ased on ttie prediction shape signal Ekm, and 
outputs shape data (coded shape bit stream 61 B) E2k 
obtained by coding ttie shape signal S2k. The arithmetic 
coding mettiod is described in more detail in ttie specifi- 
cation of JBIG standard. At ttiis time, in tiie arithmetic 
decoder 124. ttie shape data E2k is reproduced as 
decoded shape data Ekd in an arithmetic decoding 
process using the prediction shape signal Ekm, and ttie 
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decoded shape data Ekd is stored in the frame memory 
k>ank 102a 

Thereafter, the shape identifier Sdis. the shape 
motion vector Skv. and the shape data E2k are muttl- 
plexed in the multiplexer 150. and the multiplexed data 
is output from the output terminal 150a toward a data 
transmission unit (Step SaS). 

In the Image coding apparatus 100a. a control unit 
(not shown) decides whether or not the data processed 
through Steps Saa-SaS is the data of the last block In 
the last frame (Step SalO) and, when the processed 
data is not the data of the last block in the last frame, the 
process by the image coding apparatus 1 00a returns to 
Step Sa2. When it is the data of the last block in the last 
frame, the image coding process is ended. 

On the other hand, when it is decided in Step Sa2 
that the digital image input Sin is an arbitrary shape 
image signal Sp including a shape signal and a texture 
signal, a 1-bit identifier signal Sdls. of which value is "0". 
Is generated as a shape identifier (SID) In the image 
input unit 110 (Step Sa6) and, furthermore, a shape sig- 
nal Spk and a texture signal Spt are generated by the 
chromakey process of the digital image input Sin. At this 
time, the switch 101a is controlled by the switch control 
signal SWa output from the image input unit 1 1 0 so that 
the shape signal Spk is input to the shape coding unit 
120 while the texture signal Spt is input to the texture 
coding unit 130. 

Thereby, in the shape coding unit 120. the shape 
signal Spk of the arbitrary shape image signal Sp is 
subjected to arithmetic coding in the same manner as 
the above-described arithmetic coding of the shape sig- 
nal S2k of the binary image signal S2 (Step Sa7). In the 
texture coding unit 130. the texture signal Spt is sub- 
jected to coding (Step SaS). 

More specifically, in the texture coding unit 130. the 
texture motion detector 131 extracts a texture motion 
vector Stv from the texture signal Spt, and the texture 
motion compensator 132 obtains a prediction texture 
signal Epm from the frame memory bank 102a accord- 
ing to the motion vector Stv. The first adder 1 33 obtains 
difference data Sadi between the prediction texture sig- 
nal Epm and the texture signal Spt of the input arbitrary 
shape image signal. This difference data is transformed 
to DOT coefficients Edct in a frequency domain by the 
cosine transformer 134. and the DOT coefficients Edct 
are quantized by the quantizer 135. Further, the quan- 
tized DOT coefficients Eq are subjected to variable- 
length coding by the variable-length encoder 139 and 
sent to the multiplexer 150. To the multiplexer 150, the 
texture motion vector Stv of the corresponding block is 
input as well. > 

The quantized DOT coefficients Eq are subjected to 
inverse quantization by the Inverse quantizer 136. and 
the output Eiq from the inverse quantizer 136 Is sub- 
jected to Inverse cosine transformation by the inverse 
cosine transformer 137 and sent to the second adder 
138. as a reproduced texture signal Ekict. In the second 



adder 138. the reproduced texture signal Eidct and the 
prediction texture signal Epm are added, and the sum 
Sad2 Is stored in the frame memory bank 102a. 

When the digital image input is an arbitrary shape 

5 image signal, the nultiplexer 150 Is supplied with the 
shape identifier Sdis from the Image input unit 1 10, the 
shape motion vector Skv and the shape data Epk from 
the shape coding unit 120, the texture motion vector Stv 
and the texture DOT coefficients Ept from the texture 

10 coding unit 130, and other necessary signals. In the 
multiplexer 1 50, these data are an-anged in a prescribed 
order, and the coded arbitrary shape signal (Ep) 500 
shown in figure 1(a) is output from the muttiptexer 150 
(Step Sa9). 

IS Furthermore, as described with respect to the 
binary image signal. In the image coding apparatus 
100a, a control unit (not shown) decides whether the 
data processed through Steps Sa6~Sa9 is data of the 
last block in the last frame (Step SalO). When the proc- 

20 essed data Is not the data of the last block In the last 
frame, a shape signal and a texture signal con-espond- 
ing to the next block are subjected to Steps Sa6~Sa9. 
When the processed data (shape signal and texture sig- 
nal) Is the data of the last block in the last frame, the 

25 coding process by the image coding apparatus 100a is 
completed. 

The output terminal 150a of the multiplexer 150 is 
connected to a transmission unit for transmitting the 
coded data or a storage unit for storing the coded data. 

30 although these units are not shown in the figure. 

As desaibed above, according to the second 
embodiment of the Invention, the image coding appara- 
tus 100a for coding a digital image input is consfructed 
so that it decides whether the digital image input is a 

55 binary image signal or an arbitrary shape image signal, 
and outputs an Identifier signal (shape Mentifier) Side 
according to the result of the decision, together with the 
coded Image signal. Therefore, in a decoding apparatus 
for decoding a coded signal of a binary image signal or 

40 an ait>ltrary ^ape image signal, when an input coded 
signal is a coded binary signal including no coded tex- 
ture bit streams, this is detected by the above-described 
shape identifier, and the content of the decoding proc- 
ess can be changed from the process adapted to a 

45 coded arbitrary shape signal including both of coded 
shape bit sfreams and coded texture bit sfreams to the 
process adapted to the coded binary signal. 

Therefore, when coding a binary image signal 
including only a shape signal, it is not necessary to add 

60 a dummy coded texture bit stream to each coded shape 
bit sfream, whk;h dumniy sfream enables the binary 
shape signal to be decoded by a decoding method cor- 
responding to a coded arbitrary shape signal. As a 
result, it is possible to create a coded image signal hav- 

55 Ing a data structure which enables coded signals 
according to different coding methods to be decoded by 
an image decoding apparatus that employs only a sin- 
gle coding method, without Increasing the code quantity 
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required for the coding process. 
[Embocfiment 3] 

Figure 5 Is a block diagram Illustrating an Image 
decoding apparatus according to a third embodiment of 
the present Invention. In figure 5, reference nunierat 
100b designates an image decoding apparatus which 
performs decoding of coded data having a data struc- 
ture for image transmission according to the first 
embodiment of the Invention. This apparatus 100b Is 
constructed as follows. When the apparatus 100b 
receives a coded binary signal (E2) 600 as shewn in fig- 
ure 1(b) as coded data Eo, it outputs a decoded binary 
signal D2 as decoded Image data Dsyn. On the other 
hand, when the apparatus 100b receives a coded arbi- 
trary shape signal (Ep) 500 as shown in figure 1(a) as 
coded data Eo, It outputs a decoded arbitrary shape sig- 
nal Dp as decoded Image data Dsyn. for each object. 

More spedflcaily, the image decoding apparatus 
1 0Ob comprises a data analyzer 1 60 which analyzes the 
coded data Eo irput to the Input temiinal 160a and out- 
puts a switch control signal SWb according to the anal- 
ysis result; a shape decoding unit (first decoding 
means) 170 which subjects the shape data (the coded 
shape bit stream obtained by coding the shape signal) 
to an arithmetic decoding process; a texture decoding 
unit (second decoding means) 180 which subjects the 
texture OCT coefficients Ept to a decoding process 
including inverse DCT; a switch 101b which supplies the 
coded signal analyzed by and output from the data ana- 
lyzer 160 to one of the decoding units 170 and 180. 
according to the switch control signal; and a frame 
memory bank 102 which stores a prediction shape sig- 
nal and a prediction texture signal. 

When decoding of a coded shape bit stream corre- 
sponding to one block has ended, the shape decoding 
unit 1 70 detects the end of the coded shape bit stream 
Ek (E2k or Epk) corresponding to the blocK and outputs 
an end detection signal Te corresponding to the block 
toward the data analyzer 160. 

Further, the data analyzer 160 analyzes the input 
coded data to examine the 1 -bit shape Identifier that fol- 
lows the 32-bit synchronous signal at the head, which 
shape identifier is one of the shape identifier 502 in the 
coded arbitrary shape signal 500 shown In figure 1(a) 
and the shape Identifier 602 in the coded binary signal 
600 shown in figure 1(b). When the set value of the 
shape identifier (SID) is 0. the data analyzer 160 con- 
trols the switch 101b with the switch control signal SWb 
so that the coded, shape bit stream in the input coded 
signal Is input to the shape decoding unit 170 and the 
coded texture bit stream in the coded signal is input to 
the texture decoding unit 1 80. When the set value of the 
shape identifier (SID) is 1, the data analyzer 160 con- 
trols the switch 101b with the switch control signal SWb 
so that the input coded data is input to the shape decod- 
ing unit 170. 



To be specific, as shown in figure 7(b), the data 
analyzer 160 comprises a table storage unit 162 which 
contains a decoding reference table; a comparator 161 
which compares the bit stream of the input coded signal 

5 with the bit stream of the decoding reference table, 
thereby identifying the shape identifier, the coded shape 
bit stream, and the coded texture bit stream, which are 
included in the coded data; and a switch control circuit 
1 63 which controls the switch 1 01 b by the switch control 

w signal SWbi according to the comparison result from the 
comparator 161 and the end detection signal Te. 

The shape decoding unit (first decoding means) 
1 70 comprises a shape motion compensator 1 72 which 
receives the shape motion vector corresponding to the 

IS binary Image or an arbitrary shape motion vector corre- 
sponding to the arbitrary shape image, generates an 
address of the prediction shape signal stored in the 
frame memory bank 102b according to the motion vec- 
tor, and obtains the prediction shape signal Emk from 

20 the frame memory bank 102b; and an arithmetic 
decoder 171 which decodes the input shape data Ek 
with reference to the prediction shape signal Emk to 
generate a reproduced shape signal (decxxled shape 
signal) Dk. The reproduced shape signal Dk is stored In 

25 the frame memory bank 102b. When decoding of a 
coded shape bit stream corresponding to one block has 
ended, the arithmetic decoder 171 detects the end of 
the coded shape bit stream Ek (E2k or Epk) con'e- 
sponding to the blocK and outputs an end detection sig- 

30 nal Te. The motk>n compensation Is desalbed, In more 
detail, in USP (United States Patent) No. 5157742, and 
the arithmetic decoding is desalbed in the specification 
of JBIG. 

The texture decoding unit (second decoding 

35 means) 180 oonrprises a texture motion compensator 
184 which generates, according to the texture motion 
vector, an address of the prediction texture signal, and 
obtains the prediction texture signal Emp from the frame 
memory bank 102b using the address; an inverse quan- 

40 tizer 181 which receives the quantization scale and the 
DCT coefficients In the coded texture bit stream, and 
sut>jects the DCT coefficients to Inverse quantization: 
an Inverse cosine transformer 182 which subjects the 
inversely quantized DCT coefficients Diq to inverse 

45 cosine transformation; and an adder 183 which adds 
the predlctton texture signal Emp and the inversely 
coslne-transibmied signal DIdct. and outputs a repro- 
duced texture signal (decoded texture signal) Dpi The 
reproduced texture signal Dpt from the adder 183 is 

50 stored in the frame memory bank 1 02b. 

The image decoding apparatus 100b further 
includes a synthesizer 190 which synthesizes the repro- 
duced texture signal Opt and the conresponding repro- 
duced shape signal Dk with desired image data. 

55 respectively, and outputs synthesized image data Dsyn 
including the reproduced arbitrary shape signal Dp cor- 
responding to the coded arbitrary shape signal Ep 
toward the display unit 1 04. Further, the synthesizer 1 90 
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outputs the reproduced binary signal D2 con'espondlng 
to the coded binary signal E2. Although the signals out- 
put from the synthesizer 190 are input to the display unit 
104, the signals may be Input to a printer (not shown). 
Further, in the synthesizer 190. the reproduced binary 
signal D2 may be synthesized with another artsitrary 
shape image signal. 

In this third embodiment when decoding the art)i- 
trary shape image signal, with respect to pixels wherein 
the reproduced shape signal is zero, pixel values in the 
reproduced texture signal are replaced with pixel values 
of a prescribed image. The prescrit>ed image is an 
image prepared in advance at the receiving end, or an 
image reproduced by another image decoding appara- 
tus. 

A description is given of the operation of the image 
decoding apparatus so constructed. 

Rgure 6 is a flowchart of the decoding process by 
the image decoding apparatus 100b according to the 
third embodiment of the invention. When a coded image 
signal having a data structure shown in figure 1(a) or 
1 (b) is input to the image decoding apparatus 1 00b, the 
data analyzer 160 analyzes the 1-bit shape identifier 
that follows the 32-bit synchronous signal, and decides 
whether the value of the shape identifier (SID) is 1 or not 
(StepSbl). 

When the result of the decision is SID = 1 , the input 
coded image signal Eo is a coded binary signal E2 that 
includes only coded shape bit streams as image infor- 
mation. So, the data analyzer 160 controls the switch 
101b with the switch control signal SWb so that the 
coded shape bit stream corresponding to each block of 
the coded binary signal is always input to the shape 
decoding unit 170. Thereby, in the shape decoding unit 
170, the coded shape bit streams In the coded binary 
signal are subjected to decoding (Step Sb2). 

More specifically, the shape motion vector MV is 
input to the shape motion compensator 172 and the 
arithmetic decoder 171. Then, the shape motion com- 
pensator 172 generates an address of the prediction 
shape signal stored in the frame memory bank 102b 
according to the shape motion vector MV. and obtains 
the prediction shape signal Emk from the frame mem- 
ory bank 102b. When the prediction shape signal Emk 
is input to the arithmetic decoder 171, the arithmetic 
decoder 171 performs arithmetic decoding of the coded 
shape bit stream E2k with reference to the prediction 
shape signal Emk, thereby generating a decoded binary 
signal D2k. The decoded binary signal D2k is output 
toward the frame memory bank 102b and the synthe- 
sizer 190 and. from the synthesizer 190, it is output 
toward the display unit 104 for image display (Step 
Sb6). The decoded binary signal may be displayed after 
being synthesized wHh another arbitrary shape image 
signal. 

Thereafter, it is decided whether the coded binary 
signal is data of the last block In the last frame (Step 
Sb7). When the coded binary signal Is not data of the 



last block in the last frame, a coded binary signal corre- 
sponding to the next block is subjected to Steps Sbl, 
Sb2, and Sb6. When the coded binary signal Is data of 
the last block in the last frame, decoding of the coded 

5 binary signal Is ended. 

On the other hand, when the result of the decision 
in Step Sbl is SID » 0, the input coded image signal 
Includes, as image Information, coded shape bit 
streams and coded texture bit streams. Therefore, the 

10 data analyzer 160 controls the switch 101b with the 
switch control signal SWb so that the coded shape bit 
stream con^esponding to each block of the coded arbi- 
trary shape signal is input to the shape decoding unit 
1 70 while the coded texture bit stream corresponding to 

IS each block is Input to the texture decoding unit 180. 
TTiereby. the coded shape bit stream and the coded tex- 
ture bit stream are separated from each other (Step 
Sb3), and the coded shape bit stream is decoded by the 
shape decoding unit 170 while the coded texture bit 

20 Stream is decoded by the texture decoding unit 180 
(Steps Sb4 and Sb5). 

To be specific, the coded shape bit stream Epk is 
decoded by the shape decoder 170, like the coded 
shape bit stream E2k of the binary image signal. When 

25 decoding of the coded shape bit stream Epk corre- 
sponding to one block has ended, the arithmetic 
decoder 171 detects the end of the coded shape bit 
stream Epk corresponding to the block and outputs an 
end detection signal Te toward the data analyzer 160. 

30 Receiving the end detection signal Te. the data analyzer 
160 controls the switch 101b with the switch corrtrol sig- 
nal SWb so that the input coded image signal is input to 
the texture decoding unit 180. 

Thereby, the coded texture bit stream Ept is sent 

35 from the data analyzer 1 60 to the textile decoding unit 
180. In the decoding unit 180, the quantization scale 
and the DOT coefficients in the bit stream are input to 
the inverse quantizer 1 81 . and the DOT coefficients are 
subjected to inverse quantization. Thereafter, the 

40 inversely quantized signals Diq are subjected to inverse 
cosine transformation by the inverse cosine transformer 
182. 

Meanwhile, the texture motion vector MV Is input to 
the texture motion compensator 184. The compensator 

45 1 84 generates an address for obtaining a prediction tex- 
ture signal according to the texture motion vector MV, 
and obtains the prediction texture signal Emp from the 
frame memory bank 102b using the address. 

The adder 1 83 performs addition of the output Didct 

so from the inverse cosine transformer 1 82 and the predic- 
tion texture signal Emp. and outputs the decoded tex- 
ture signal Dpt. The decoded texture signal Dpt Is input 
to the frame memory bank 102b and the synthesizer 
190. The synthesizer 190 synthesizes the decoded and 

ss reproduced texture signal Dpt and the corresponding 
decoded and reproduced shape signal Dk with a 
desired image to generate synthesized image data 
Dsyn. When decoding of the coded texture bit stream 
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has ended, the data analyzer 160 detects the end of the 
coded texture bit stream, and controls the switch 101b 
by the switch control signal SWb so that the input coded 
image signal is input to the shape decoding unit 170. 

Further, the reproduced and synthesized data is s 
output from the synthesizer 190 toward the display unit 
104 for image display (Step Sb6). 

Thereafter, it is decided whether the coded arbHrary 
shape signal is data of the last block in the last frame 
(Step SbT). When the coded arbitrary shape signal is io 
not data of the last block in the last frame, a coded arbi- 
trary shape signal of the next block is subjected to Steps 
Sb3~Sb7. When the coded arbitrary shape signal is 
data of the last block in the last frame, decoding of the 
coded arbitrary shape signal is ended. is 

In this third embodiment, with respect to pixels 
wherein the reproduced shape signal is zero, pixel val- 
ues in the decoded and reproduced texture signal are 
replaced with pixel values of a prescribed imaga The 
prescribed image is an image prepared in advance at 20 
the receiving end, or an image reproduced by another 
image decoding apparatus. 

As desaibed above, according to the third errtxxii- 
ment of the invention, the image decoding apparatus 
100b includes the data analyzer 160 which analyzes the ss 
input coded data. The data analyzer 160 detects a 
shape identifier which indicates whether the input coded 
image agnal is a coded binary signal including only 
coded shape bit streams as image information or a 
coded arbitrary shape signal Including both of coded 30 
shape bit streams and coded texture txt streams and, 
according to the value of the shape identifier, the ana- 
lyzer 1 60 controls the switch 1 01 b so that the bit stream 
of the input coded signal is input to one of the shape 
decoding unit 170 and the texture decoding unit 180. 3s 
So, even though a dummy coded texture bit stream is 
not added to each coded shape bit stream when aeat- 
ing a coded binary signal, it is possible to perfbnm 
decoding of the coded binary signal by a decoding 
method conresponding to a coded aMrary shape sig- 40 
nal. Therefore, when both of a binary image signal and 
an arbitrary shape image signal, which have different 
data structures, are coded by a single coding method 
and these coded signals are decoded by a single 
decoding method, it is possible to efficiently perfbnn 45 
coding, transmission, and decoding of the binary image 
signal with suppressed bit number. 

[Embodiment 4] 

60 

Figure 8 is a' block diagram illustrating an image 
decoding apparatus according to a fourth errtbodiment 
of the present invention. In figure 8. reference numeral 
100c designates an image decoding apparatus accord- 
ing to this fourth embodiment. The image decoding 55 
apparatus 100c includes a controller 105, in addition to 
the structure of the Image decoding apparatus 100b 
according to the third embodiment. The controller 105 



monitors the load on the decoding process of the tex- 
ture decoding unit 180 according to the operating state 
of the synthesizer 1 90c and outputs an overload detec- 
tion signal Lov when the load exceeds a prescribed 
value. 

Further, the image decoding apparatus 100c 
includes, instead of the data analyzer 160 according to 
the third embodiment, a data analyzer 1 66 which gener- 
ates a switch control signal SWc according to the end 
detection signal Te and the overload detection signal 
Lov. TTie other structure of the data analyzer 166 is 
identiced to that of the data analyzer 160. Further, the 
inrage decoding apparatus 100c includes, instead off the 
switch 101b according to the third embodiment a switch 
101c which has an input terminal Cin, to which a coded 
image signal from the data analyzer 166 is input, and 
three output contacts Col, Co2 and Co3, and selects 
one of the three contacts in response to the switch con- 
trol signal SWc. The output contact Co^ is connected to 
the input of the arithmetic decoder 171 , the output con- 
tact Co2 is grounded, and the output contact Co3 is 
connected to the input of the inverse quantizer 181 and 
to the input of the motion compensator 184. 

Furthermore, the controller 105 has a plurality of 
functions for managing the whole decoding apparatus. 
One of the functions is as follows. When synthesis of an 
image corresponding to one frame is not completed 
within a time interval for image display of one frame, 
which interval is set in advance, the controller 105 
detects that the load Lxle on the decoding process in the 
texture decoding untt 180 is heavy and outputs the 
switch control signal SWc. 

Receiving the overload detection signal Lov. the 
data analyzer 1 66 controls the switch 1 01 c by the switch 
control signal SWc so that the input terminal Cin is 
switched between the first output contact Col and the 
second output contact Co2. More specifically, the switch 
101c is controlled so that the coded texture bit stream 
Ept of the coded arbitrary shape signal Ep is input to the 
grounded end while the coded shape bit stream Ekt of 
the coded arbitrary shape signal Ep Is input to the arith- 
metic decoder 171. 

Further, in this fourth embodiment, the synthesizer 
190c has the following function in addition to the func- 
tion of the synthesizer 190 according to the third 
embodiment. That is, when the decoding process of the 
coded texture signal is heavily loaded as described 
above, the synthesizer 190c synthesizes the decoded 
shape signal conresponding to the present frame being 
processed with the decoded texture signal of the previ- 
ous frame, instead of the decoded texture signal corre- 
sponding to the present frame. 

When the data analyzer 1 66 is not supplied with the 
overload detection signal Lov, i.e., when the image 
decoding process is not heavily loaded, the data ana- 
lyzer 166 controls the switch 101c k>y the switch control 
signal SWc so that the input terminal Cin is connected 
to one of the first output contact Col and the third output 
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contact Co3. Thereby, the image decoding apparatus 
100c according to the fourth embodiment perfbmis an 
Image decoding process identical to that of the Image 
deoocfing apparatus 1 00b according to the third embod- 
iment 5 

A description is given of the operation of the image 
decoding apparatus 100c according to the fourth 
erribodiment. 

Since the fundamental operation of the image 
decoding apparatus 100c is identical to that of the io 
image decoding apparatus 100b according to the third 
embodiment, only the operation relating to the controller 
105 will be described hereinafter. 

For example, when the coded arbitrary shape sig- 
nal Ep is being decoded in the texture decoding unit is 
180, if synthesis of the decoded image signal corre- 
sponding the frame being processed is not completed 
the time when the Image of this frame is to be dis- 
played, the controller 1 05 detects that the image decod- 
ing process is heaviiy loaded and outputs the overload 20 
detection signal Lov toward the data analyzer 166. 
Then, the switch 101c is controlled by the switch control 
signal SWc from the data analyzer 166. whereby the 
coded shape bit stream Epk of the coded arbitrary 
shape signal Ep from the data analyzer 1 66 is supplied 25 
through the first output contact Col of the switch 101c 
to the shape decoding unit 170 while the coded texture 
bit stream Ept of the coded arbitrary shape signal Ep is 
supplied through the second output contact Co2 of the 
switch 101c toward the ground. so 

Further, instead of the decoded texture signal cor- 
responding to the present frame being processed, the 
decoded texture signal of the previous frame is synthe- 
sized with the decoded shape signal conresponding to 
the present frame. ss 

As described at)ove. according to the fourth 
embodiment of the invention, the load of the arithmetic 
processor in the image decoding apparatus is moni- 
tored and, when decoding of the arbitrary shape image 
signal corresponding to each frame is late for the timing 40 
to display the image conresponding to each frame, only 
the coded shape bit stream in the coded arbitrary shape 
signal is reproduced, and image display is performed 
using a coded texture bit stream which has previously 
been reproduced. Therefore, even when the decoding 46 
process is heavily loaded, it is possible to realize image 
display in which the displayed Image is not discontinued 
and the imageflows smoothly. 

In this fourth embodiment, as a method of detecting 
the load on the decoding process, when the decoded 5a 
image signal corresponding to each frame is late for the 
timing to cfisplay the image corresponding to the frame, 
it Is decided that the decoding process is heavily 
loaded. However, the load detecting method is not 
restricted thereto. ss 

Further, in this fourth embodiment, when the 
decoding process is over-loaded, only the coded shape 
bit stream In the coded arbitrary shape signal is 



decoded and the coded texture bit stream in the coded 
arbitrary shape signal is not decoded. However, only the 
coded texture bit stream nfiay be decoded without 
decoding the coded shape bit stream. 

In this case, instead of the decoded shape signal 
corresponding to the present frame being processed, 
the decoded shape signal con'esponding to the previ- 
ous frame is synthesized with the decoded texture sig- 
nal corresponding to the present frame. 

[Embodiment 5] 

Rgure 9 is a block diagram illustrating an Image 
decoding apparatus according to a fifth embodiment of 
the present invention. In figure 9, reference numeral 
lOOd designates an image decoding apparatus accord- 
ing to this fifth embodiment. The image decoding appa- 
ratus 100d includes an irput terminal 106, such as a 
mouse or a remote controller, for inputting a manual 
control signal Min from the outside to the image decod- 
ing apparatus lOOd, instead of the controller 105 for 
detecting the load on the decoding process, included in 
the image decoding apparatus 100c according to the 
fourth emtxxfimeni The manual control signal MIn from 
the input terminal 106 is Input to the data analyzer 165, 
instead of the overload detection signal Lov. Other parts 
are identical to those described for the fourth embodi- 
ment. 

Receiving the manual control signal Min, the data 
analyzer 165 controls the switch lOlcbythe switch con- 
trol signal SWc so that the input temninal Cin is con- 
nected to one of the first output contact Col and the 
second output contact Co2. More specifically, the switch 
101c is controlled so that the coded texture bit stream 
Ept of the coded art)itrary shape signal Ep is input to the 
grounded end while the coded shape bit stream Ekt of 
the coded arbitrary shape signal Ep is input to the arith- 
metic decoder 171. 

Also In this fifth emkxxJiment. as in the fourth 
embodim^ when the manual control signal Min is 
being output toward the data analyzer 165, instead of 
the decoded texture signal corresponding to the present 
frame being processed, the decoded texture signal cor- 
responding to the previous frame is synthesized with the 
decoded shape signal con'esponding to the present 
frame. 

When the data analyzer 165 does not receive the 
manual control signal Min, it controls the switch 101c by 
the switch control signal SWc so that the input terminal 
Cin is connected to one of the first output contact Col 
and the third output contact Co3. Thereby, the image 
decoding apparatus lOOd according to the fifth embodi- 
ment performs an image decoding process identical to 
that of the image decoding apparatus 1 00b according to 
the third embodiment. 

As described above, the image decoding apparatus 
1 0Od according to the fifth embodiment is provided with 
the input terminal 106, such as a mouse or a remote 
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controller, for inputting the nianua) control signal Min 
from the outside, and the control of the switch 101c by 
the data analyzer 165 Is changed according to the man- 
ual control signal Min from the Input terminal 106. 
Therefore, until the user obtains a reproduced inmge by 5 
the user's control, only the coded shape bit stream can 
be decoded without decoding the coded texture bit 
stream, and this enables the user to quickly detect the 
head of the object Image when reproducing a coded sig- 
nal recorded in a record medium. 10 

In the second to fifth emt>odlments of the invention, 
the coding process or the decoding process is applied 
to the coded arbitrary shape signal 500 figure 1 (a)) and 
the coded binary signal 600 (figure 1(b)) which corre- 
spond to the inter-frame prediction coding method, is 
However, the fundamental principle of the present 
invention, i.e.. to add an image identifier for identifying 
image signals having different data structures, such as 
an arbitrary shape Image signal and a binary image sig- 
nal when coding these image signals for transmission. 20 
and to detect the image identifier when decoding these 
coded signals so as to make the decoding process cor- 
respond to the coded signals, such as a coded arbitrary 
shape signal and a coded binary signal, can be applied 
to the coded arbitrary shape signal 500b having the 2S 
data structure shown in figure 2(a) and the coded binary 
signal 600b having the data structure shown In figure 
2(b). 

Further, in the first to fifth embodiments of the 
Invention, as image kientlfiers for identifying coded 30 
image signals having different data structures, 
employed are shape Identifiers (SID = 0 or 1) each com- 
prising a 1-bit code for identifying a coded arbitrary 
shape signal or a coded binary signal. However, image 
Identifiers comprising 2-blt codes (SID « 00. 01, 10, or 3S 
1 1) or 3-bit codes may be employed. In this case, it is 
possible to identify more coded image signals by the 
image identifiers. 

When a plurality of coded image signals are identi- 
fied with the image identifiers, for a prescribed coded 40 
image signal, an Image Identifier, of which bit number is 
different from those of Image Identifiers of other coded 
image signals, may be employed. For example, a coded 
image signal including an image identifier comprising a 
2-bit code and a coded image signal including an Image 45 
identifier comprising a 3-blt code may be treated by a 
system conresponding to a single coding method. In this 
case, code allocation to each image identifier can be 
carried out with high efficiency. 

Hereinafter, a desaiption is given of a data struc- so 
ture for image transmission and an image decoding 
method, which employ image identifiers comprising 
codes of two or more bits. 

[Embodiment 6] ss 

Rgures 10(a)-10(c) are diagrams for explaining 
data structures for image transmission according to a 



sixth embodiment of the present invention. Rgure 10(a) 
shows a data structure of a coded arbitrary shape signal 
obtained by coding an art)itrary shape image signal cor- 
responding to each of plural objects constituting a dis- 
play image. Figure 10(b) shows a data structure of a 
coded binary signal obtained by coding a binary image 
signal. Figure 10(c) shows a data structure of a coded 
rectangle signal (coded pixel value signal) obtained by 
coding a rectangle image signal Including, as display 
data, only a texture signal (pixel value signaQ for color 
display of an image. 

These data structures fa image transmission 
according to the sixth embodiment are applied to a sys- 
tem in which a rectangle image signal including, as dis- 
play data, only a texture signal (i.e., luminance signal 
and color difference signal) is compressively coded and 
transmitted and, further, the coded rectangle image sig- 
nal Is decoded and displayed. That Is. in this system, the 
image coding method and apparatus are constructed to 
perfomi a coding process for the rectangle image signal 
while the image decoding method and apparatus are 
constructed to perform a decoding process for the 
coded rectangle image signal (coded pixel value signal). 

In figure 10(a). reference numeral 1500 designates 
a coded arbitrary shape signal obtained by coding an 
arbitrary shape image signal corresponding to each of 
plural objects constituting an image of one display 
image. This coded arbitrary shape signal 1500 is identi- 
cal to the coded arbitrary shape signal 500 according to 
the first embodiment except that a two-bit image klentl- 
fier 1502 Is used instead of the 1 -bit shape kientifler 
502. 

In figure 10(b). reference numeral 1600 designates 
a coded binary signal obtained by coding a binary 
image signal that represents image infonnation on one 
display image with a binary signal. The coded binary 
signal 1 600 is identical to the coded binary shape signal 
600 according to the first emtxxliment except that a two- 
bit image identifier 1602 is emptoyed instead of tiie 1 -bit 
shape klentrf ler 602. 

In figure 10(c). reference numeral 1700 designates 
a coded pixel value signal which is a coded rectangle 
signal obtained by coding a rectangle signal that 
includes information about the vertical and horizontal 
size of one display image (one frame). This coded pixel 
value signal (coded rectangle signal) 1 700 is identical to 
the coded pixel value signal 700a shown In figure 23(c) 
except that a two-bit image identifier 1702 is inserted 
between the synchronous signal 701 and the header 
703. 

The 2-bit image kJentifiers (SID) 1502, 1602. and 
1702 have values of 01. 10, and 00. respectively, and 
the coded signals 1500, 1600, and 1700 are identified 
by the values of these image identifiers. 

A description is given of the function and effect 
In the sixth embodiment so constructed, the coded 
pixel value signal 1700 conresponding to the rectangle 
image signal includes coded texture bit streams 71 C 
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obtained by coding a texture signal, and a two-bit image 
identifier 1702 indicating that the signal 1700 includes 
only the coded texture bit streams as display data. So, 
by referring to the image identrfio* 1702. among the 
three coded signals, i.e.. the coded artxtrary shape sig- s 
nal 1500. the coded binary signal 1600. and the coded 
pixel value signal 1700. the coded pixel value signal 
1700 can be distinguished from the other signals 1500 
and 1600. 

To be specific, in an image decoding apparatus io 
adapted to MPEG2 and constructed to decode the 
coded pixel value signal 1700. even when the coded 
artxtrary shape signal 1500 or the coded binary signal 
1600 is input, these coded signals can be recognized as 
signals different from the coded pixel value signal 1700 is 
by the image identifier. Therefore, it is possible to avoid 
that the coded arbitrary shape signal 1 500 or the coded 
binary signal 1600 Is subjected to the decoding process 
adapted to MPEQ2 and the decoding operation comes 
to a rig)ture. Further, when these coded signals are so 
input, the fact that these signals are not decodable can 
be displayed on the display image. 

In this sixth embodiment of the invention, the coded 
artxtrary shape signal 1500. the coded binary signal 
1600, and the coded rectangle signal (coded pixel value 25 
signal] 1700 have the data structures obtained by inter- 
frame prediction coding of an arbitrary shape image sig- 
nal, a binary image signal, and a rectangle image sig- 
nal, respectively. However, these coded signals may 
have data structures obtained by intra-frame coding of 3o 
the respective image signals. 

Furthermore, in the respective coded signals 
employed in this sixth embodiment, both or either of the 
coded shape bit stream and the coded texture bit 
stream areTis arranged for each block. However, in each ss 
coded signal, presaibed coded bit streams may be 
arranged for each frame. 

[Embodiment 7] 

40 

figure 11 is a block diagram illustrating an image 
decoding apparatus according to a seventh embodi- 
ment of the invention. In figure 11. reference numeral 
lOOe designates an iniage decoding apparatus for 
decoding coded data having the data structures for 45 
image transmission according to the sixth embodiment 
of the invention. This image decoding apparatus lOOe is 
constructed as follows. When the apparatus lOOe 
receives, as coded data Eo, the coded arbitrary shape 
signal (Ep) 1500 shown in figure 10(a) and the coded so 
binary signal (E2) 1600 shown in figure 10(b). it does 
not decode these coded signals but dsplays that these 
coded signals currently being input are not decodat)le. 
On the other hand, when the apparatus 100e receives, 
as coded data Eo. the coded rectangle signal (Et) 1 700 ss 
shown in figure 10(c), it outputs a decoded rectangle 
signal Dt as decoded image data 

More specifically, the Image decoding apparatus 



lOOe comprises a data emalyzer I60e which analyzes 
the coded data Eo input to the input terminal 160a and 
outputs a switch control signal SWe according to the 
analysis result; a texture decoding unit I80e which sub- 
jects the coded rectangle signal (coded pixel value sig- 
nal) Et to a decoding process including inverse OCT; a 
switch lOle which supplies the coded signal analyzed 
by and output from the data analyzer 1 60e to one of the 
decoding unit ISOe and the grounded end; and a frame 
memory bank 102e which stores a prediction texture 
signal. 

The data analyzer 160e analyzes the input coded 
data to examine the two-bit image identifier that follows 
the 32-bit synchronous signal at the head, which image 
identifier is one of the image identifier (SID = 01) 1502 
in the coded arbitrary shape signal 1500 shown in figure 
10(a), the image identifier (SID « 10) 1602 in the coded 
binary signal shown in figure 10(b). and the image iden- 
tifier (SID = 00) 1702 in the coded rectangle signal 
shown In figure 10(c). When the set value of the image 
identifier (SID) is 01 or 10. the data analyzer 160e con- 
trols the switch lOle with the switch control signal SWe 
so that the input coded signal is applied to the grounded 
end. When the set value of the image identifier (SID) is 
00, the data analyzer 160e controls the switch 1 01 e with 
the switch control signal SWe so that the input coded 
data is input to the decoding unit 1 BOe. 

Further, the structure of the data analyzer 160e is 
identical to that of the data analyzer 160 according to 
the third embodiment shown in figure 7(b), and tiie 
structure of the texture decoding unit 1 SOe is identical to 
that of the texture decoding unit 180 according to tiie 
third entbodiment. 

In the image decoding apparatus lOOe. the 
decoded (reproducecf) texture signal Dt. i.e.. the output 
from the decoding unit 180e, is directly input to the 
frame memory bank 102e and to the display unit 104. 
However, a synthesizer identical to the synthesizer 190 
employed for the third embodiment (refer to figure 5) 
may be disposed before the display unit 1 04 so that the 
decoded texture signal Dt is synthesized with another 
decoded arbitrary shape signal. 

A description is given of the operation of the image 
decoding apparatus lOOe. 

Figure 12 is a flowchart of ttie decoding process by 
ttie image decoding apparatus lOOe according to ttie 
seventii embodiment of tiie invention. When a coded 
inrtage signal having a data structure shown in any of fig- 
ures 10(a), 10(b), and 10(c) is input to the image decod- 
ing apparatus lOOe. ttie data analyzer 160e analyzes 
ttie 2-brt image identifier ttiat follows ttie 32-bit synchro- 
nous signal, and decides whether tiie value of the 
image identifier (SID) is 00 or not (Step Sel). 

When ttie result of tiie decision is not SID = 00 but 
SID = 01 or SID => 10. since the input coded image sig- 
nal Eo is a coded arbitrary shape signal Ep or a coded 
binary signal E2, tiie data analyzer 160e controls ttie 
switch 101 e wtth tiie switch control signal SWe so ttiat 
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the coded signal is supplied to the grounded end. 
Thereby, the coded art>itrary shape signal Ep or the 
coded binary signal E2 is discarded (Step Se3). There- 
fore, the coded Image signal E2 or Ep including coded 
shape bit streams Is never processed by the decoding 
unit 180e. 

While the coded arbitrary shape signal Ep or the 
coded binary signal E2 Is being Input to the apparatus 
100e, the apparatus 100e displays a message that the 
coded signal being currently input cannot be processed 
by this decoding apparatus lOOe (Step Se4). 

Thereafter, it Is decided whether the input coded 
signal is data of the last block of the last frame (Step 
Se6). When the Input coded signal is not data of the last 
block of the last frame, an input coded signal corre- 
sponding to the next block is subjected to Steps Se1. 
Se3, Se4. and SeS. Conversely, when the input signal is 
data of the last block of the last frame, decoding of the 
input signal is ended. 

On the other hand, when the result of the decision 
In Step Se1 is SID = 00. since the input coded data Eo 
is a coded rectangle signal Et. the data analyzer 160e 
controls the switch lOle with the switch control signal 
SWe so that the coded signal is input to the decoding 
unit 180e. Thereby, the texture decoding unit 180e 
decodes the coded texture bit stream included in the 
coded rectangle signal Et (Step Se2). 

To be specific, in the decoding unit 180e. the quan- 
tization scale and tiie DOT coefficients included in the 
bit stream are input to the inverse quantizer 181. and 
the DCT coefficients are subjected to inverse quantiza- 
tion. Thereafter, the inversely quantized signal Diq is 
subjected to inverse cosine transformation by tiie 
inverse cosine translbrmer 182. 

Meanwhile, the texture motion vector MV is input to 
the texture motion compensator 184. The compensator 
1 84 generates an address for obtaining a prediction tex- 
ture signal according to the texture motion vector MV. 
and obtains tiie prediction texture signal Emp from tiie 
frame memory bank 102e using tiie address. 

The adder 1 83 performs addition of the output Didct 
from the inverse cosine transformer 182 and the predic- 
tion texture signal Emp. and outputs the decoded tex- 
ture signal Dpt (decoded rectangle signal) toward the 
display unit 104 (Step SeS). Simultaneously, tiie 
decoded texture signal Dt Is input to the frame memory 
bank 102e. A synttiesizer may be disposed after tiie 
decoding unit to synthesize tiie decoded rectangle sig- 
nal with another arbitrary shape image signal, for dis- 
play. 

Thereafter, it is decided whetiier the coded rectan- 
gle signal Et is data of tiie last block of the last frame 
(Step Se6). When the signed Et is not data of the last 
block of the last frame, a coded rectangle signal of tiie 
next block is subjected to Steps Sel. Se2. SeS. and 
Se6. When the signal Et is data of tiie last block of tiie 
last frame, decoding of tiie coded rectangle signal Is 
ended. 



As described above. accorcOng to tiie sixtti embod- 
iment of tiie invention, ttie image decoding apparatus 
lOOe includes tiie data analyzer 160e which analyzes 
tiie Input coded data. The data analyzer 1606 detects. 

5 witii the two-bit image identifier, whether ttie coded 
image signal input to tiie apparatus is a coded signal 
including coded shape bit streams as image information 
(i.e., the coded binary signal E2 or the coded arbitrary 
shape signal Ep) or a coded rectangle signal Et indud- 

10 ing no coded shape bit streams and, according to ttie 
result of the decision, ttie analyzer 160e controls the 
switch 101 e so that tfie input coded signal is input to 
one of ttie grounded end and the decoding unit 180e. 
Therefore, even when the coded art^itrary shape signal 

IS Ep or the coded binary signal E2 is Input to the image 
decoding apparatus lOOe adapted to the coded rectan- 
gle signal Et. these coded signals are not decoded, 
whereby ttie decoding operation is prevented from com- 
ing to a rupture. 

so In ttiis seventh embodiment of tiie invention, 
emphasis has been placed on the image decoding 
apparatus lOOe which selects, according to an image 
identifier, a coded signal including coded shape bit 
streams from ttie coded signals having ttie data struc- 

25 tures according to the sixtii embodiment, i.e., ttie coded 
arbitrary shape signal 1S00. tiie coded binary signal 
1600, and the coded rectangle signal 1700. However, 
when ttie image input unit 110 in the image coding 
apparatus 100a according to the second embodiment 

30 (refer to figure 3) is constructed so ttiat It can kJentify an 
arbitrary shape image signal, a binary image signal, and 
a rectangle image signal, it is possible to Implement an 
image coding apparatus that performs coding of these 
image signals with image identifiers for klentrfying ttie 

35 coded signals con-esponding to these image signals 

[Embodiment 8] 

Figures 13(a) and 13(b) and figures 14(a) and 14(b) 
40 are diagranrs for explaining data structures for image 
transmissk)n according to an eightii embodiment of tiie 
present invention. More specif toally, figure 13(a) shows 
a data structure of a coded arbitrary shape signal (first 
coded aibitrary shape signal) 2S00 obtained by coding 
45 an arbitrary shape image signal including botii of coded 
shape bit streams and coded texture bit streams, and 
figure 13(b) shows a data structure of a coded binary 
signal 2600 obtained by coding a binary image signal. 
Figure 14(b) shows a data structure of a coded rectan- 
50 gle signal (coded pixel value signal) 2700 obtained by 
coding a rectangle image signal, and figure 14(b) shows 
a data stiticture of a coded arbitrary shape signal with 
transparency information (second coded arb'rtrary 
shape signal) 2800 obtained by coding an arbitrary 
65 shape image signal including transparency information. 
These data structures for image transmission 
according to ttie eightti embodiment are applied to a 
system in which the ait)itrary shape image signal indud- 
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ing transparency information is compressively coded 
and transmitted and. further, the second coded arbitrary 
shape signal obtained by the compressive coding is 
decoded and displayed. That is. in this system, the 
image coding method and apparatus are constructed to 
perform a coding process for the arbitrary shape image 
signal including transparency information while the 
image decoding method and apparatus are constructed 
to perform a decoding process for the second coded 
arbitrary shape signal. 

The first coded arbitrary shape signal 2500 shown 
in figure 13(a) is identical to the coded arbitrary shape 
signal 1 500 according to the sixth embodiment shown in 
figure 10(a). that is, it is obtained by replacing the 1-bit 
shape identifier 502 in the coded arbitrary shape signal 
500 according to the first embodiment with a two-bit 
image identifier 2502. 

The coded binary shape signal 2600 shown in fig- 
ure 13(b) is identical to the coded binary shape signal 
1600 according to the sixth embodiment shown in figure 
10(b). that is, it is obtained by replacing the 1-bit shape 
identifier 602 in the coded binary shape signal 800 
according to the first entbodiment with a two-bit image 
identifier 2602. 

The coded pixel value signal 2700 shown in figure 
14(a) is identical to the coded pixel value signal 1700 
acccHTding to the sixth emtxxJiment shown in figure 
10(c). that is. it is obtained by inserting a two-bit image 
identifier 2702 between the synchronous signal 701 and 
the header 703 in the coded pixel value signal 700a 
shown in figure 23(c). 

The second coded arbitrary shape signal 2800 
shown in figure 1 4(b) includes a 32-brt synchronous sig- 
nal 801 at the beginning, a two-bit image identifier (SID) 
2802 that follows the synchronous signal 801. and an 
additional header 803 that follows the image identifier 
2802. 

Further, the second coded arbitrary shape signal 
2800 includes coded shape bit streams 81 D obtained 
by coding a shape signal (binary transparency signal) 
that represents the shape of each object as a constitu- 
ent of the arbitrary shape Image signal with transpar- 
ency information; coded texture bit streams (coded pixel 
value streams) 82D obtained by coding a texture signal 
(pixel value signal) that conprises a luminance signal 
and a color difference signal for color display of each 
object as a constituent of tiie arbitrary shape image sig- 
nal witii transparency information; amd coded transpar- 
ency bit streams 83D obtained by coding a multivalued 
transparency signal that represents the transparency of 
each object as a constituent of the arbitrary shape 
image signal with transparency information. 

To be specific. In tiie coded arbitrary shape signal 
2800. for each of plural blocks into which an object 
region including an object on a display image is divided, 
a coded shape bit stream 81 D, a coded texture bit 
stream 82D. and a coded transparency bit stream 83D 
are arranged in ttiis order. 



More specifically, following ttie header 803. 
arranged are a coded shape bit stream 81D1, a coded 
texture bit stream 82D1, and a coded transparency bit 
stream 83D1 corresponding to a block D1; a coded 

5 shape bit stream 81 D2. a coded texture bit stream 
82D2. and a coded transparency bit stream 83D2 con-e- 
sponding to a block D2; and a coded shape bit stream 
81 D3. a coded texture bit stream 82D3. and a coded 
transparency bit stream 83D3 corresponding to a block 

10 D3. 

Further, as shown in figure 14(b). the coded shape 
bit streams 81D1. 81 D2. and 81D3 comprise variat}le- 
lengtti coded data 804, 812, and 820 corresponding to 
shape motion vectors (in the figure, referred to simply as 

IS shape MV); and variable-length coded data 805. 813, 
and 821 corre^nding to binary shape signals (binary 
transparency signals), each signal indicating whettter 
pixels witiiin ttie tHodk are located inside tiie object or 
outside tfie object (in the figure, shape data), respec- 

20 tively. 

The coded texture bit streams 82D1. 82D2, and 
82D3 comprise 5-bit coded data 806. 814. and 822 cor- 
responding to quantization scales (in the figure, quanti- 
zation scale); variabie-lengtti coded data 807. 815, and 

25 823 corresponding to texture motion vectors (in the fig- 
ure, texture MV); and variable-length coded data 808. 
816. and 824 corresponding to quantized signals 
obtained by subjecting the texture signal to DOT and 
quantization (in tiie figure, texture DOT coefficients). 

^ respectively. 

The coded transparency bit streams 83D1. 83D2, 
and 83D3 comprise 5-bit coded data 809. 817. and 825 
corresponding to quantization scales (in tiie figure, 
quantization scale); variable-lengtii coded data 810, 

35 818. and 826 corresponding to transparency motion 
vectors (in the figure, transparency MV): and variable- 
length coded data 811. 819, and 827 corresponding to 
quantized signals obtained by subjecting tiie multival- 
ued transparency signal to DCT and quantization (in tiie 

40 figure, transparency DCT coefficients), respectively- 

The synchronous signal 801 is a signal indicating 
the head of a coded arbitrary shape signal con'espond- 
ing to one object and this is a unique coded signal. The 
shape identifier (SID) 2802 is a signal indicating which 

45 type is the coded image signal among tiie above- 
described four types of coded image signals, i.e.. it is a 
signal for identifying tiie kind of tiie bit streams included 
in tiie coded Image signal. Wh^ the value of the image 
identifier (SID) Is 01. it indicates that botii of tiie coded 

50 shape bit streams and tiie coded texture bit streams 
exist in tiie coded image signal. When SID e io, ttie 
image identifier indicates tiiat only tiie coded shape bit 
streams exist In the coded signal. When SID = 00. the 
image identifier indicates that only tiie coded texture bit 

55 streams exist in tiie coded signal. When SID is 1 1 . the 
image identifier indicates that the coded shape bit 
streams, ttie coded texture bit streams, and ttie coded 
transparency bit streams exist in the coded signal. 
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The header 803 includes information relating to, for 
example, the time to display the Image of the oorre- 
sponcfing object, the attribute of the image, and the pre- 
diction mode for coding. However, these data have no 
relationship with the present invention and. therefore. 5 
do not require detailed description. 

The shape MV is the coded data of a motion vector 
which shows a motion of an image within a block 
between the present frame and tiie previous frame, and 
this is used for prediction of a shape signal of a specific 10 
block in the present frame from a shape signal of the 
con^esponding block in the previous frame. Furtiier, tiie 
shape data is obtained by subjecting a shape signal to 
arithmetic coding, and the quantization scale (in the 
coded texture bit stream) is a parameter for inversely is 
quantizing DCT coefficients wtiich are otstained by sub- 
jecting a texture signal to DCT and quantization. The 
texture MV is a coded signal of a texture motion vector 
which shows a motion of an image witiiin a bfock 
between the present frame and ti7e previous frame, and 20 
this is used for prediction of a texture signal of tiie 
present frame from a texture signal of the previous 
frame. Further, the texture DCT coefficients are 
obtained by subjecting a quantized signal of the texture 
signal to variable-length coding. Further, tiie transpar- 25 
ency MV is a coded signal of a transparency motion 
vector which shows a motion of an image within a block 
between the present frame and tiie previous frame, and 
this is used for prediction of a multivalued transparency 
signal of tiie present frame from a multivalued transpar- 30 
ency signal of the previous frame. Furthermore, the 
quantization scale (\n the coded transparency bit 
sta'eam) is a parameter for inversely quantizing transpar- 
ency DCT coefficients which are obtained by subjecting 
a multivalued transparency signal to DCT and quantize- 3s 
tion. The transparency DCT coefficients are obtained by 
subjecting a quantized signal of tiie transparency signal 
to variable-length coding. 

In tiie coded arbitrary shape signal 2800. actually. 
varkMJS kinds of skJe information (data) are arranged 40 
t>efore the texture DCT coefficients altiiough these data 
are not shown In the figure, and these skie data some- 
times require a large number of bits. 

A description is now given of the function and effect 

In the eightii embodiment so constructed, since the 45 
four coded image signals having different data struc- 
tures, i.e.. the first coded art>ibBry shape signal 2500 
corresponding to an arbitiary shape image signal, the 
coded binary signal 2600 corresponding to a binary 
image signal, the coded pixel value signal (coded rec- so 
tangle signal) 2700 corresponding to a rectangle image 
signal, and tiie second coded art>ftrary shape signal 
2800 corresponding to an arbitrary shape image signal 
with transparency information, include the two-bit image 
identifiers 2502, 2602, 2702, and 2802 for identifying ss 
these coded signals, respectively. Therefore, those four 
coded signals can be kientif led at the decoding end by 
referring to the image identifiers. 



To be specific In an image decoding apparatus 
adapted to MPEG4 and constructed to decode tiie 
coded arbitrary shape signal mentioned above, even 
when the coded binary signal and the coded rectangle 
signal are input besMes tiie first and second coded arbi- 
trary shape signals, the Image identifiers enable the 
apparatus to appropriately decode ttie coded binary sig- 
nal and tiie coded rectangle signal. Therefore, it is pos- 
sible to avokl tiiat ttie coded binary signal and the coded 
rectangle signal are subjected to the decoding process 
adapted to MPEQ4 and the decoding operation oomes 
to a rupture. 

In this eighfli embodiment off the invention, the first 
and second coded arbitrary shape signals, the coded 
binary signal, and the coded rectangle signal have the 
data structure obtained by inter-frame prediction cod- 
ing of an arbitrary shape image signal, an arbitrary 
shape image signal witfi transparency information, a 
binary image signal, and a rectangle image signal, 
respectively. However, tiiese coded signals may have 
data structures obtained by intra-frame ooding of the 
respective image signals. 

Furthermore, in tiie respective coded signals 
employed in this eighth embodiment, at least one of tiie 
coded shape bit stream, ttie coded texture bit stream, 
and ttie coded transparency bit stream is arranged for 
each block. However, in each coded signal, prescribed 
coded bit streams may be arranged fbr each frame 
(refer to figures 2(a) and 2(b)). 

Furthermore, in ttie data structure of ttie second 
coded arbitrary shape signal 2800 (coded signal of the 
arbitrary shape image signal witti transparency informa- 
tion) shown in figure 14(b), each of ttie coded transpar- 
ency bit streams 83D includes a transparency MV and a 
quantization scale, like ttie coded texture bit streams 
82D. However, it is not always necessary for ttie coded 
transparency bit stream 83D in ttie second coded arbi- 
trary shape signal 2800 to have the transparency MV 
and ttie quantization scale. 

When ttie coded signal of ttie arbitrary shape image 
signal witti transparency information has the data struc- 
ture in which ttie coded transparency bit streams 83D 
do not include transparency MVs and quantization 
scales, decoding of ttie transparency DCT coefficients 
is can-led out using tiie texture MVs and the quantiza- 
tion scales of ttie coded texture bit streams 82D. 

[Embodiments] 

Figure 15 is a block diagram illustrating an image 
decoding apparatus according to a nlntti embodiment of 
ttie present invention. In figure 15. reference numeral 
lOOf designates an image decoding apparatus which 
performs decoding of coded data having tiie data struc- 
ture for image transmission according to the eighth 
embodiment. The image decoding apparatus lOOf is 
constructed to perform a decoding process according to 
tiie data structure of a coded signal input as coded data. 
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More specifically, the apparatus lOOf is constructed 
as follows. When the apparatus 1 0Of receives the coded 
binary signal (E2) 2600 shown in figure 13(b) as coded 
data Eo, rt outputs a decoded binary signal D2 as 
decoded image data Dsyn. When the apparatus lOOf 
receives the first coded arbitrary shape signal (Ep) 2500 
shown in figure 13(a) as coded data Eo, it outputs a 
decoded arbitrary shape signal Dp as decoded innage 
data Dsyn. for each object When the apparatus lOOf 
receives the coded rectangle signal (Et) 2700 shown in 
figure 1 4(a) as coded data Eo. it outputs a decoded rec- 
tangle signal Dt as decoded image data Dsyn. When 
the apparatus lOOf receives the second coded £irbitrary 
shape signal (Ex) 2800 shown in figure 14(b) as coded 
data Eo, it out)uts a decoded arbitrary shape signal Dx 
with transparency information as decoded image data 
Dsyn. for each object. 

Hereinafter, the structure of the Image decoding 
apparatus 100f will be described in detail. 

The apparatus lOOf comprises a data analyzer 160f 
which analyzes the coded data Eo input to the input ter- 
minal 160a and outputs a switch control signal SWf 
according to the analysis result: a shape decoding unit 
(first decoding means) 170 which subjects the shape 
data (coded shape signal) to an arithmetic decoding 
process; a texture decoding unit (second decoding 
means) 180f which subjects the texture DOT coeffi- 
cients Ept and the transparency DCT coefficients Egt to 
a decoding process including inverse DCT; a switch 
101f which supplies the coded signal analyzed by and 
output from the data analyzer 1 60f to one of the decod- 
ing units 170 and 180f. according to the switch control 
signal SWf; and a frame memory bank 102f which 
stores a prediction shape signal, a prediction texture 
signal, and a prediction transparency signal. 

The data analyzer ISOf analyzes the input coded 
signal to examine the 2-bit image identifier that follows 
the 32-bit synchronous signal at the head (any of the 
image identifiers 2502. 2602, 2702. and 2802 in the 
coded signals shown in figures 13(a), 13(b), 14(a). and 
14(b), respectively), and controls the switch lOlf 
according to the set value of the image identifier (SID). 

When SID = 01, the switch lOlf is controlled by the 
switch control signal SWf so that the coded shape bit 
streams of the input coded signal are input to the shape 
decoding unit 1 70 and the coded texture bit streams of 
the coded signal are input to the texture decoding unit 
180f. When SID = 10. the switch lOlf is controlled by 
the switch control signal SWf so that the input coded 
data is input to the shape decoding unit 170. When SID 
= 00, the switch 101! is controlled by the switch control 
signal SWf so that the coded texture bit streams of the 
input coded signal are input to the texture decoding 
means 180f. When SID = 11. the switoh lOlf is control- 
led by the switch control signal SWf so that the coded 
shape bit streams of the input coded signal are input to 
the shape decoding unit 1 70, and the coded texture bit 
streams and the coded transparency bit streams are 



input to the texture decoding unit 180f. 

Like the data analyzer 160 according to the third 
embodiment shown in figure 7(b), the data analyzer 
160f comprises a table storage unit 162, a comparator 

5 161. and a switch control circuit 163. In this ninth 
embodiment, the comparator 161 compares the bit 
stream of the input coded signal with the bit stream of 
the decoding reference table stored in the table storage 
unit 162, and identifies the Image identifier, coded 

10 shape bit stream, coded texture bit stream, and coded 
transparency bit stream, which are included in the 
coded data. According to the result of the identification, 
the conparator 161 outputs a switoh control signal SWf 
toward the switch lOlf. 

15 The texture decoding unit (second decoding 
means) 180f includes a texture motion compensator 
184f which generates, according to the texture motion 
vector or the transparency motion vector, an address for 
obtaining a prediction texture signal or a prediction 

20 transparency signal, and obtains a prediction texture 
signal Emp or a prediction transparency signal Emg 
from the frame memay bank 102b using the address. 
Further, the texture decoding unit 180f includes an 
Inverse quantizer 181f which receives the quantization 

25 scale and the DCT coefficients In the coded texture bit 
stream or the coded transparency bit stream, and sub- 
jects the DCT coefficients to inverse quantization; and 
an inverse cosine transformer 1^ which subjects the 
inversely quantized DCT coefficients Diq to inverse 

30 cosine transfonttation. Furthennore. the texture decod- 
ing unit 180f includes an adder 183 which adds the pre- 
diction texture signal Emp or the prediction 
transparency signal Emg to the Inversely cosine-trans- 
formed signal Didct, and outputs a reproduced texture 

35 signal (decoded texture signaQ Dpt a a reproduced 
transparency signal (decoded transparency signal) 
Dpg. The reproduced texture signal Dpt or the repro- 
duced transparency signal Dpg from the adder 183 is 
stored in the frame memory bank 102f. 

40 The image decoding apparatus lOOf further 
includes a synthesizer I90f which synthesizes the out- 
put of the decoding unit 180f (both of the reproduced 
texture signal Dpt and the reproduced transparency sig- 
nal Dpg, or only the reproduced texture signal Dpt) and 

45 the output of the decoding unit 170 (the reproduced 
shape signal Dk conresponding to the output of the 
decoding unit 180f) with desired image data, and out- 
puts synthesized image data Dsyn including the repro- 
duced arbitrary shape signal Dx with transparency 

so information or the reproduced arbitrary shape signal Dp 
toward the display unit 104. Although the synthesizer 
190f according to the ninth embodiment outputs the 
reproduced binary signal D2 from the decoding unit 170 
or the reproduced rectangle signal Dt from the decoding 

55 unit 1 80f directly to the display unit 1 04, the signal D2 or 
Dt may be synthesized with another arbitrary shape 
image signal in the synthesizer 190f. Although the sig- 
nal output from the synthesizer 190f is input to the dls- 
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play unit 104, rt rmy be input to an information output 
apparatus such as a printer (not shewn). 

In this ninth embodiment, with respect to pixels 
wherein the reproduced shape signal is zero, pixel val- 
ues in the reproduced texture signal and the reproduced 
transparency signal are replaced with pixel values of a 
presaibed image. The prescribed image is an image 
prepared In advance at the receiving end. or an image 
reproduced by another image decoding apparatus. 

A description is given of the operation of the image 
decoding apparatus lOOf according to the ninth embod- 
iment. 

Figure 16 is a flowchart of the decoding process by 
the image decoding apparatus lOOf. When a coded 
image signal having a data structure shown in any of fig- 
ures 13(a). 13(b). 14(a). and 14(b) is input to the image 
decoding apparatus lOOf. the data analyzer 160f ana- 
lyzes the a-bit image identifier that follows the 32-bit 
synchronous signal In the coded image signal, and 
decides whether the value of the inr»ge identifier is "SID 
= 00orir or not (Step Sfl). 

When the result of the decision is SID = 00 or 1 1 , it 
isdecided whether SID = 00 or not (Step Sf2). When the 
result of the decision in Step Sf2 is SID o oo. since the 
input coded image signal Eo is the coded rectangle sig- 
nal Et. the data analyzer 160f controls the switch lOlf 
with the switch control signal SWf so that the coded sig- 
nal Is always Input to the texture decoding unit 180f. 
Thereby, in the texture decoding unit I80f, the coded 
texture bit streams in the coded rectangle signal are 
subjected to decoding (Step Sf3). TTie decoding proc- 
ess in Step SfS is identical to the decoding process in 
Step Se2 according to the seventh embodiment. Then, 
the decoded rectangle signal Is sent through the synthe- 
sizer 190f to the display unit 104 to be displayed (Step 
Sf13). In the synthesizer 190f. the decoded rectangle 
signal Dg may be synthesized with another art)itrary 
shape image signal. 

Thereafter. It is decided whether the coded rectan- 
gle signal Et is data of the last block of the last frame 
(Step Sfl 4). When the coded rectangle signal is not 
data of the last block of the last frame, a coded rectan- 
gle signal corresponding to the next block is subjected 
to Steps Sf 1~Sf3, Sfl3, and Sf14. Conversely, when the 
coded rectangle signal is data of the last block of the 
last frame, decoding off the coded rectangle signal is 
ended. 

On the o^er hand, when the result of the decision 
in Step Sf2 is SID = 1 1 , the input coded image signal is 
the second coded arbitrary shape signal Ex including, 
as image information, the coded shape bit streams, the 
coded texture bit streams, and the coded transparency 
bit streams. So, the data analyzer 160f controls the 
switch lOlf with the ^tch control signal SWf so that 
the coded shape bit stream corresponding to each bkxk 
of the coded arbitrary shape signal Ex with transpar- 
ency signal is input to the shape decoding unit 1 70 while 
the coded texture bit stream and the coded transpar- 



ency bit stream con'esponding to the block are input to 
the texture decoding unit 180f. Thereby, in the second 
coded arbitrary shape signal Ex, the coded shape bit 
stream is separated from the coded texture bit stream 

5 and the coded transparency bit stream (Step Sf4). and 
the separated shape bit stream is decoded by the shape 
decoding unit 170 (Step SfS) while the separated tex- 
ture bit stream and the transparency bit stream are 
decoded by the texture decoding unit 180f (Steps S16 

10 and Sf7). 

To be specific, the coded shape bit stream Epk is 
decoded ksy the shape decoder 170, like the coded 
shape bit stream E2k of the binary image signal. When 
decoding of the coded shape bit stream Epk corre- 

15 sponding to one block has ended, the arithmetic 
decoder 171 detects the end of the coded shape bit 
stream Epk corresponding to this block and outputs an 
end detection signal Te toward the data analyzer 160f. 
Receiving the end detection signal Te, the data analyzer 

20 160f controls the switch 101b with the switch control sig- 
nal SWb so that the input coded image signal is input to 
the texture decoding unit 180f. 

Thereby, the coded texture bit stream Ept and the 
coded transparency bit stream Epg are sent from the 

25 data analyzer 1 60f to the texture decoding unit 1 80f . In 
the decoding unit 180f. the quantization scale and the 
DOT coefficients of each bit stream are input to the 
inverse quantizer 181f, and the DOT coefficients are 
subjected to inverse quantization. Thereafter, the 

30 inversely quantized signal Diq is subjected to inverse 
cosine transformation by the inverse cosine trarisformer 
182f. 

Meanwhile, the texture motion vector MV and the 
transparency motion vector MV are input to the texture 

35 motion compensator 184f. The compensator 184f gen- 
erates addresses for obtaining a prediction texture sig- 
nal and a prediction transparency signal, according to 
these motion vectors MV, and obtains a prediction tex- 
ture signal Emp and a prediction transparency signal 

40 Emg from the frame memory bank 102b using the 
addresses. 

The adder 1 83 performs addition of the output Didct 
from the inverse cosine transformer 182f and the predic- 
tion texture signal Emp or the prediction transparency 

45 signal Emg, and outputs a decoded texture signal Dpt or 
a decoded transparency signal Dpg. These decoded 
signals Dpt and Dpg are input to the frame memory 
bank 102f and the synthesizer 190f. In the synthesizer 
190f. the reproduced texture signal Dpt, the reproduced 

50 transparency signal Dpg. and the corresponding repro- 
duced shape signal Dk are synthesized with a desired 
image to generate synthesized image data Dsyn. When 
decoding of the coded transparency bit stream has 
ended, the data analyzer 160f detects the end of the 

55 coded transparency bit stream, and controls the switch 
lOlf by the switch control signal SWb so that the input 
coded image signal is input to the shape decoding unit 
170. 
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Further, the reproduced and synthesized data 
(decoded arbitrary shape signal with transparency infor- 
mation) Dx is output from the synthesizer 190f to the 
display unit 104 for image display (Step Sf13). 

Thereafter, it is decided whether the second coded s 
artxtrary shape signal is data of the last block of the last 
frame (Step Sf 14). When it is not data of the last block 
of the last frame, a second coded aibitrary shape signal 
corresponding to the next block is subjected to Steps 
Sf1, Sf2. Sf4-Sf7. Sf13. and Sf14. Conversely, when it 
is data of the last block of the last frame, decoding of the 
second coded arbitrary shape signal is ended. 

When it is decided in Step Sf 1 that the value of the 
image identifier is not "SID » 00 or 11". it Is decided in 
Step Sf8 whether SID = 1 0 or not When the result of the 
decision in Step Sf8 Is SID 10, since the input coded 
image signal Eo is the coded k)inary signal E2 that 
includes only the coded shape bit streams as image 
intonfnation, the data analyzer 160f controls the switch 
101f with the switch control signal SWf so that the 
coded shape bit stream corresponding to each block in 
the coded binary signal is always input to the shape 
decoding unit 170. Thereby, in the shape decoding unit 
170, the coded shape bit streams in the coded binary 
signal are subjected to decoding (Step Sf9). The decod- 
ing process in Step Sf9 is identical to the decoding proc- 
ess in Step Sb2 according to the third enrtediment. 
Then, the decoded binary signal D2 is sent through the 
synthesizer 190f to the display unit 104 to be displayed 
(Step Sf13). In the synthesizer 190f. the decoded binary 
signal D2 may be synthesized with another arbitrary 
shape Image signal. 

Thereafter. It is decided whether the coded binary 
signal is data of the last block of the last frame (Step 
Sf14). When it is not data of the last bfock of the last 
frame, a coded binary signal con-esponding to the next 
block is subjected to Steps Sfl. Sf8. Sf9, SfIS, and 
Sf 14. Conversely, when it is data of the last block of the 
last frame, decoding of the coded binary signal is 
ended. 

On the other hand, when the result of the decision 
in Step Sf8 is SID b oi, the input coded image signal is 
the first coded arbitrary shape signal including, as 
image information, the coded shape bit streams and the 
coded texture bit streams. So. the data analyzer 160f 
controls the switch lOlf with the switch control signal 
SWf so that the coded shape bit stream corresponding 
to each block of the coded arbitrary shape signal is input 
to the shape decoding unit 170 while the coded texture 
bit stream con-esponding to the block is input to the tex- 
ture decoding unit 180f. Thereby, in the first coded arbi- 
trary shape signal, the coded shape bit stream and the 
coded texture bit stream are separated from each other 
(Step SflO), and the separated shape bit stream is 
decoded by the shape decoding unit 170 (Step Sfll) 
while the separated texture bit stream is decoded by the 
texture decoding unit 180f (Step Sf12). Further, these 
streams are displayed by the display unit 104 (Step 



SfIS). The decoding processes in Steps Sf1 1 and Sf12 
are identical to the decoding processes in Steps Sb4 
and Sb5 according to the third embodiment, respec- 
tively, and the image display in Step Sfl 3 is identical to 
the image display in Step Sb6 according to the third 
embodiment 

Thereafter, it is decided whether the first coded 
ariMrary shape signal Ep is data of the last block of the 
last frame (Step Sfl4). When it is not data of the last 
block of the last frame, a first coded arbitrary shape sig- 
nal Ep corresponding to the next block is subjected to 
Steps Sfl, Sf8. and Sf10~Sf14. Conversely, when it is 
data off the last block of the last frame, decoding of the 
first coded arbitrary shape signal Ep is ended. 

In the decoding process according to this ninth 
emtxxliment when decoding the first or second coded 
arbitrary shape innage signal, with respect to pixels 
wherein the reproduced shape signal is zero, pixel val- 
ues in the reproduced texture signal and the reproduced 
transparency ^gnal are replaced with pixel values of a 
prescribed image. The prescribed image is an image 
prepared in advance at the receiving end. or an Image 
reproduced by another image decoding apparatus. 

As described above, according to the ninth embod- 
iment of the invention, the Image decoding apparatus 
lOOf includes the data analyzer 160f for analyzing the 
Input coded data. The data analyzer I60f detects an 
image identifier indicating which coded signal is the 
Input coded image signal among tiie coded binary sig- 
nal E2, the first coded arbitrary shape signal Ep, the 
second coded arbitrary shape signal Ex, and the coded 
rectangle signal Eg and, according to the value of the 
Image identifier, the analyzer ISOf controls the switoh 
1 01 f so tiiat the bit streanns In the input coded signal are 
appropriately input to one of tiie shape decoding unit 
170 and the texture decoding unit 180f. Therefore, the 
above-mentioned four coded image signals having dif- 
ferent data structures can be decoded by decoding 
processes con'esponding to a single coding method. 

In tills nintti embodiment of the invention, tiie coded 
shape bit stream is decoded by the arithmetic decoding 
method (first decoding method) in the shape decoding 
unit 170, and the coded texture bit stream and the 
coded transparency bit stream are decoded by the 
same decoding method Including DCT. In other words, 
tiie decoding method tor the coded texture bit stream 
(second decoding mettiod) Is identical to tiie decoding 
method for the coded transparency bit stream (third 
decoding method). However, the coded transparency bit 
stream may be decoded by a decoding method includ- 
ing wavelet processing or the like (tiiird decoding 
metiiod) whfoh is different from tiie decoding metiiod 
including DCT (second decoding method). 

In this nintii embodiment of tiie Invention, emphasis 
has been placed on tiie image decoding apparatus lOOf 
which identifies the coded signals having tiie data struc- 
ture described for ttie eightii embodiment, i.e.. first and 
second coded aibitrary shape signals, a coded binary 
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Signal, and a coded rectangle signal, using their image 
identifiers, and performs decoding processes according 
to the respective data structures. However, when the 
image input unit 110 in the image coding apparatus 
1 00a according to the second embodiment shown in fig- 5 
ure 3 is constructed so that H can identify an arbitrary 
shape image signal, a binary image signal, a rectangle 
image signal, and an arbitrary shape image signal with 
transparency information, It is possOsle to Implement an 
image coding apparatus that performs coding of these w 
image signals with image identifiers for identifying tiie 
coded signals con^esponding to ttiese image signals. 

[Entbodiment 10] . 

75 

Figures 1 7(a)-1 7(c) and figures 18(a)-18(b) are dia- 
grams for explaining data structures for Intage transmis- 
sion according to a tenth enrtxxliment of the present 
Invention. More specifically, figure 17(a) shows a data 
structure of a coded arbitrary shape signal (first coded 20 
arbibBry shape signal) 3500 obtained by coding an arbi- 
trary shape image signal including both of coded shape 
bit streams and coded texture bit streams, figure 17(b) 
shows a data structure of a coded binary signal 3600 
obtained by coding a binary image signal, and figure ss 
1 7(c) shows a data structure of a coded rectangle signal 
(coded pixel value signal) 3700 obtained by coding a 
rectangle image signal which Includes, as display data, 
only a texture signal (pixel value signal) for color display 
of an Image. Further, figure 18(a) shows a data struc- 30 
ture of a coded arbitrary shape signal with transparency 
information (second coded ar1}itrary shape signal) 3800 
obtained by coding an arbitrary shape Image signal 
including transparency information, and figure 18(b) 
shows a data structure of a coded transparency signal 3s 
3900 obtained by coding an arbitrary shape transpar- 
ency signal including both of coded shape bit sti-eams 
and coded transparency t)it streams. 

These data structures for image transmission 
according to the tenth embodiment are applied to a sys- 4o 
tem In which ttie arbitrary shape image signal Including 
transparency information is compresslvely coded and 
transmitted and. further, the second coded arbitrary 
shape signal obtained by the compressive coding is 
decoded and displayed. That is, in tills system, tiie 45 
image coding method and apparatus are constructed to 
perform a coding process for tiie arbitrary shape image 
signal including transparency Information while the 
image decoding method and apparatus are constructed 
to perform a decoding process for the second coded so 
arbitrary shape signal. 

The first coded arbitrary shape signal 3500 shown 
in figure 17(a) is identical to ttie coded arbitrary shape 
signal 2500 according to the eightti emtxxJiment shown 
In figure 13(a), that is. it Is obtained by replacing the 1 - 6S 
bit shape Identifier 502 In the coded arbitrary shape sig- 
nal 500 according to the first embodiment with a two-bit 
Image identifier 3502. 



The coded binary shape agnal 3600 shown in fig- 
ure 17(b) is identical to tiie coded binary shape signal 
2600 according to the eighth embodiment shown in fig- 
ure 13(b), tiiat is, it is obtained by replacing the 1-bit 
shape identifier 602 in the coded binary shape signal 
600 according to the first emkxxiiment with a two-bit 
image identifier 3602. 

The coded rectangle signal (coded pixel value sig- 
nal) 3700 shown in figure 17(c) is identical to the coded 
rectangle signal 2700 according to tiie eightti embodi- 
ment shown in figure 14(a), that is, it is obtained by 
inserting a two-ksit image identifier 3702 between ttie 
synchronous signal 701 and the header 703 in ttie 
coded pixel value signal 700a shown in figure 23(c). 

The second coded arbitrary shape signal 3800 
shown in f igure 18(a) is identical to tiie second coded 
arbitrary shape signal 2800 according to the eightti 
embodiment shown in figure 14(b), and has a two-bit 
image identifier 3802. 

Further, the coded transparency signal shown in 
figure 18(b) includes a 32-bit synchronous signal 901 at 
tiie beginning, a 3-bit image identifier (SID) 3902 that 
follows the synchronous signal 901, and an additional 
header 903 ttiat follows the identifier 3902. 

Furttier. ttie coded tiBnsparency signal 3900 
includes coded shape bit streams 91 E otDtained by cod- 
ing a shape signal (binary transparency signal) that rep- 
resents ttie shape of each ok^ject as a constituent of the 
arbitrary shape transparency signal; and coded trans- 
parency bit streams 92E obtained by coding a multival- 
ued transparency signal used for gradation display of 
tiie transparency of each object as a constituent of tiie 
arbitrary shape image signal. To be specific, in the 
coded transparency signal 3900, for each of plural 
blocks Into which an object region Including an ol^ect on 
a display image is divided, a coded shape bit stream 
91 E and a coded transparency bit stream 92E are 
arranged in this order. 

More specifically, following tiie header 903. 
ananged are a coded shape bit stream 91E1 and a 
coded transparency bit stream 92E1 con'esponding to a 
block El; a coded shape bit stream 91E2 and a coded 
transparency bit stream 92E2 conesponding to a block 
E2; and a coded shape bit stream 91 E3 and a coded 
transparency bit stream 92E3 con'esponding to a bfock 
E3. 

Further, as shown in figure 18(b), ttie coded shape 
bit streams 91 El, 91 E2, and 91 E3 comprise variable- 
lengtii coded data 904, 909, and 914 con^espondlng to 
shape motion vectors (in ttie figure, referred to simply as 
shape MV): and variable-length coded data 905, 910. 
and 915 corresponding to binary shape signals (binary 
transparency signals), each signal indicating whether 
pixels within the block are located inside the object or 
outside ttie object (in the figure, shape data), respec- 
tively. 

The coded transparency bit streams 92E1, 92E2. 
and 92E3 comprise 5-bit coded data 906, 91 1 , and 91 6 
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corresponding to quantization scales (in the figure, 
quantization scale); variable-length coded data 907. 
912, and 917 corresponding to transparency motion 
vectors (in the figure, transparency MV); and variable- 
length coded data 908. 913. and 918 corresponding to $ 
quantized signals obtained by subjecting the multival- 
ued transparency signal to DOT and quantization (in the 
figure, transparency OCT coefficients), respectively. 

The synchronous signal 901 is a signal indicating 
the head of a coded transparency signal corresponding 
to one object, and this Is a unique coded signal. TTie 
image identifier (SID) 3902 is a signal Indicating which 
type is the coded image signal among the abovenran- 
tioned five types of coded image signals, i.e.. it is a sig- 
nal for identifying the kind of the bit streams included in 
the coded Image signal. When the value of the image 
identifier (SID) is 10. the identifier indicates that both of 
the coded shape bit streams and the coded texture bit 
streams exist, as display data, in the coded image sig- 
nal. When SID s 010. the image identifier indicates that 
only the coded shape bit streams exist In the coded sig- 
nal. When SID = 00, the image identifier indicates that 
only the coded texture bit streams exist in the coded sig- 
nal. When SID is 11, the image identifier indicates that 
the coded shape bit streams, the coded texture bit 
streams, and the coded transparency bit streams exist 
In the coded signal. Further, when SID = 011. the image 
Identifier indicates that the coded shape bit streams and 
the coded transparency bit streams exist in the coded 
signal. 

The header 903 includes information relating to. for 
example, the time to display the image of the corre- 
sponding object, the attribute of the image, and the pre- 
diction mode tor coding. However, these data have no 
relationship with the present invention and. therefore, 
do not require detailed description. 

The shape MV is the coded data of a motion vector 
which shows a motion of an image within a block 
between the present frame and the previous frame, and 
this is used for prediction of a shape signal of a specific 
block in the present frame from a shape signal of the 
con'esponding block in the previous frame. Further, the 
shape data is obtained by subjecting a shape signal to 
arithmetic coding, and the quantization scale is a 
parameter for inversely quantizing DCT coefficients 
which are ot>tained by subjecting a nnultivalued trans- 
parency signal to DCT and quantization. Hie transpar- 
ency MV is a coded signal of a transparency motion 
vector which shows a motion of an image within a block 
between the present frame and the previous frame, and 
this is used for prediction of a multivalued transparency 
signal of the present frame from a nruiltivalued transpar- 
ency signal of the previous frame. Further, the transpar- 
ency DCT coefficients are obtained by subjecting a 
quantized signal of the multivalued transparency signal 
to variable-length coding. 

In the coded transparency signal 3900. actually, 
various kinds of side information (data) are anBnged 



before the transparency DCT coefficients although 
these data are not shown in the figure, and these side 
data sometimes require a large number of bits. 

A description is now given of the function and effect. 

In the tenth emtxxJiment so constructed, since the 
five coded image signals having different data struc- 
tures, i.e.. the first coded arbitrary shape signal 3500, 
the coded binary signal 3600. the coded rectangle sig- 
nal 3700. the second coded arbitrary shape signal 
3800. and the coded transparency signal 3900 include 
the image identifiers 3502, 3602, 3702. 3802. and 3902 
for identifying these coded signals, respectively. There- 
fore, these five coded signals can be identified at ttie 
decoding end by refen'Ing to tiie image identifiers. 

To be specific, in an image decoding apparatus 
adapted to MPEG4 and constructed to decode the 
coded arbitrary shape signal mentioned above, even 
when the coded binary signal and ttie coded rectangle 
signal are Input beskles the first and second coded arbi- 
trary shape signals and the arbitrary shape transpar- 
ency signal, the Image identifiers enat)Ie tiie apparatjs 
to appropriately decode the coded binary signal and the 
coded rectangle signal. Therefore, it is possible to avoid 
that the coded binary signal and the coded rectangle 
signal are subjected to the decoding process adapted to 
MPEG4 and tiie decoding operation comes to a rupture. 

While In this tenth emt)odiment the respective 
coded signals having different data structures are 
obtained by inter-frame prediction coding, these coded 
signals may be obtained by intra-frame coding. 

Furthermore, in tiie respective coded signals 
employed in this tentti emtxxliment, at least one of the 
coded shape bit stream, tiie coded texture bit stream, 
and ttie coded transparency bit stream is an-anged for 
each block. However, in each coded signal, prescribed 
coded bit streams may be ananged for each frame. 

Furthermore, in tiie data structure of tiie second 
coded arbitrary shape signal 3800 (coded signal of the 
arbitrary shape image signal witti transparency informa- 
tion) shown in figure 18(a), each of tiie coded transpar- 
ency bit streams 83D includes a transparency M V and a 
quantization scale, as in the eightti embodiment of the 
invention. However, it is not always necessary for the 
coded transparency bit stream 83D in the second coded 
arbitrary shape signal 3800 to have the transparency 
MV and the quantization scale, and decoding of ttie 
transparency DCT coefficients may be can'ied out using 
the texture MV and tiie quantization scale In ttie coded 
texture bit stream 82D. 

[Enft)odiment11] 

Rgure 19 is a block diagram illustrating an image 
decoding apparatus according to an eleventii embodi- 
ment of ttie present invention. In figure 11, reference 
numeral lOOg designates an image decoding apparatus 
which performs decoding of coded data having the data 
structure for image transmission according to the tentii 
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embodiment. The image decoding apparatus 100g is 
constructed to perform a decoding process according to 
the data structure of a coded signal input as coded data. 

More specifically, the apparatus lOOg is con- 
structed as follows. When the apparatus lOOg receives s 
the coded binary signal (E2) 3600 shown in figure 17(b) 
as coded data Eo, it outputs a decoded binary signal D2 
as decoded Image data Dsyn. When the apparatus 
1 0Og receives the first coded arbitrary shape signal (Ep) 
3500 shown in figure 1 7(a) as coded data Eo. it outputs 
a decoded arbitrary shape sigr^ Dp as decoded image 
data Dsyn, for each object When the apparatus lOOg 
receives the coded rectangle signal (Et) 3700 shown In 
figure 17(c) as coded data Eo, it outputs a decoded rec- 
tangle signal Dt as decoded Image data Dsyn. When 
the apparatus 1 0Og receives the second coded arbitrary 
shape signal (Ex) 3800 shown in figure 18(a) as coded 
data Eo, It outputs a decoded arbitrary shape signal Dx 
with transparency Information as decoded image data 
Dsyn, for each object. When the apparatus lOOg 
receives the coded transparency signal (Ep) 3900 
shown in figure 18(b). it outputs a decoded transpar- 
ency signal Dg as decoded image data Dsyn for each 
object 

Hereinafter, the structure of the image decoding 
apparatus lOOg will be descnbed in detail. 

The apparatus I00g comprises a data analyzer 
160g which analyzes the coded data Eo input to the 
Input terminal 160a and outputs a switch control signal 
SWg according to the analysis result; a shape decoding 
unit (first decoding means) 170 which subjects the 
shape data (coded shape signal) to an arithmetic 
decoding process; a texture decoding unit (second 
decoding means) .180f which subjects the texture DCT 
coefficients Ept arid the transparency DCT coefficients 
Egt to a decoding process including inverse DCT; a 
switch 101g which supplies the coded signal analyzed 
by and output from the data analyzer 160g to one of the 
decoding units 170 and 180f. according to the switch 
control signal; and a frame menrtory bank 102f which 
stores a prediction shape signal, a prediction texture 
signal, and a prediction transparency signal. 

The data analyzer 160g analyzes the input coded 
signal to examine the 2-brt image identifier that follows 
the 32-bit synchronous signal at the head O-o., any of 
the image identifiers 3502. 3702, and 3802 in the coded 
signals shown in figures 17(a), 17(c), and 18(a). respec- 
tively), and controls the switch 1 01 g according to the set 
value of the image identifier (SID). 

When tiie set value of the image identifier (SID) is 
10, the switch lOlg is controlled by the mtch control 
signal SWg so that the coded shape bit streams of tiie 
input coded signal are input to the shape decoding unit 
1 70 and the coded texture bit streams of the coded sig- 
nal are input to the texture decoding unit 180f. When 
SID n 010. the switch lOlg is contrdted by the switch 
control signal SWg so that the input coded data Is irqxit 
to the shape decoding unit 170. When SID = 00, tiie 



switch 101g is controlled by the switch control signal 
SWg so that tiie coded texture bit streams of the input 
coded signal are input to the texture decoding means 
180f. When SID = 11, the switch lOlg is controlled by 
the switch control signal SWg so that the coded shape 
bit streams of the input coded signal are input to the 
shape decoding unit 170, and tiie coded texture bit 
streams and the coded transparency bit streams are 
input to the texture decoding unit 180f. When SID = 011, 
tiie switch 1 01 g is controlled by the switch control signal 
SWg so tiiat tiie coded shape bit streams in tiie input 
coded signal are input to tiie shape decoding unit 170 
while tiie coded transparency bit streams are input to 
tiie texture decoding unit 180f. 

Like the data analyzer 160 according to the third 
embodiment shown in figure 7(b), tiie data analyzer 
160g comprises a table storage unit 162. a comparator 
161, and a switch control circuit 163. In this eleventti 
embodiment, the comparator 161 compares the bit 
stream of the input coded signal with tiie bit stream of 
tiie decoding reference table stored in the table storage 
unit 162, and identifies tiie image identifier, coded 
shape bit stream, coded texture bit stream, and coded 
transparency bit stream, which are included in the 
coded data. According to tiie result of tiie kientif ication, 
tiie comparator 161 controls the switch lOlg with the 
switch control signal SWg. 

The image decoding apparatus lOOg further 
includes a synthesizer 190g which synthesizes the out- 
put of tiie decoding unit 180f (botti of ttie reproduced 
texture signal Dpt and tiie reproduced transparency sig- 
nal Dpg, or only the reproduced texture signal Dpt or tiie 
r^roduced transparency signal Dgt) and the output of 
tiie decoding unit 170 (the reproduced shape signal Dk 
con^esponding to tiie output of the decoding unit 180f) 
witti desired image data, and outputs synttiesized 
image data Dsyn including one of tiie reproduced arbi- 
trary shape signal Dx with transparency information, the 
reproduced arbitrary shape signal Dp, and the repro- 
duced transparency signal Dg, toward ttie display unit 
104. Altiiough tiie syntiiesizer I90g according to ttie 
eleventh emtxxliment outputs the reproduced binary 
signal D2 from tiie decoding unit 1 70 or ttie reproduced 
rectangle signal Dt from the decoding unit 1 80f directly 
to ttie display unit 104, ttie signal D2 or Dt may be syn- 
ttiesized with anotiier arbitrary shape image signal in 
tiie syntiiesizer 190g. Although ttie signal output from 
tiie synthesizer 190g is input to the display unit 104, it 
may be input to an information output apparatus such 
as a printer (not shown). Other constituents are identical 
to tiiose already described for ttie nintti embodiment 

In tills eleventh emtx)diment, witti respect to pixels 
wherein ttie reproduced shape signal is zero, pixels val- 
ues in the reproduced texture signal are replaced with 
pixel values of a prescribed image. The prescribed 
image is an image prepared in advance at tiie receiving 
end, or an image reproduced by another image decod- 
ing apparatus. 
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A description given of the operation of the image 
decoding apparatus lOOg according to the eleventh 
embodiment. 

Figure 20 is a flowchart of the decoding process by 
the image decoding apparatus lOOg. When a coded s 
image signal has^ng the data structure shown in any of 
figures 17(a). 17(b), 17(c), 18(a), and 18(b) is input to 
the Image decoding apparatus lOOg. the data analyzer 
160g analyzes the 2-bit code that follows the 32-bit syn- 
chronous signal in the coded image signal, and decides io 
whether this 2-brt code is 01 or not (Step Sgl). When 
the 2'i)it code is not 01 , it is further decided whether the 
2-bit code Is. as the value of the Image Identifier. "SID = 
00orirornot(StepSg2). 

When the result of the decision In Step Sg2 is SID is 
s 00 or 1 1 , it is decided whether SID s oo or not (Step 
SgS). When the result of the decision in Step Sg3 is SID 
= 00, since the input coded image signal Eo is the 
coded rectangle signal (coded pixel value signal) Et, the 
data analyzer 160g controls the switch lOlg with the so 
switch control signal SWg so that the coded signal is 
always input to the texture decoding unit 180f. Thereby, 
in the texture decoding unit 180f. the coded texture bit 
streams (coded pixel value bit streams) in the coded 
rectangle signal are subjected to decoding (Step Sg4). 25 
The decoding process in Step Sg4 is identical to the 
decoding process in Step Se2 according to the seventh 
embodiment. Thereafter, the decoded rectangle signal 
Dt is sent through the synthesizer 190g to the display 
unit 104 to be displayed as an Image (Step Sg18). In the so 
synthesizer 190g. the decoded rectangle signal Dt may 
be synthesized with another arbitrary shape image sig- 
nal. 

Next, it is decided whether the coded rectangle sig- 
nal Et is data of the last blod^ of the last frame (Step ss 
Sgl 9). When the coded rectangle signal is not data of 
the last block of the last frame, a coded rectangle signal 
Et corresponding to the next block is subjected to Steps 
Sg1~Sg4. Sg18. and Sg19. Conversely, when the 
coded rectangle signal is data off the last block of the 4o 
last frame, decoding of the coded rectangle signal is 
ended. 

On the other hand, when the result of the decision 
in Step Sg3 is SID » 1 1 , the input coded image signal is 
the second coded arbitrary shape signal including, as 4S 
image infbrnnation. the coded shape bit streams, the 
coded texture bit streams, and the coded transparency 
bit streams. So, tfie data analyzer 160g controls the 
switch lOlg with the switch control signal SWg so that 
the coded shape bit ^eam corresponding to each block so 
of the second coded arbitrary shape signal is input to 
the shape decoding unit 170 while the coded texture bit 
stream and the coded transparency bit stream corre- 
sponding to the block are input to the texture decoding 
unit 1 80f. Thereby, in the second coded arbitrary shape ss 
signal, the coded shape bit stream is separated from the 
coded texture bit stream and the coded transparency bit 
stream (Step Sg5). and the separated shape bit stream 



is decoded t^y the shape decoding unit 170 (Step SgS) 
while the separated texture bit stream and transparency 
bit stream are decoded by the texture decoding unit 
I80f (Steps Sg7 and Sg8). The processes in Steps 
Sg5~Sg8 are identical to those in Steps Sf4~Sf7 
according to the ninth embodiment The decoded shape 
signal DxK the decoded texture signal Dxt, and the 
decoded transparency signal Dgt are synthesized by 
the synthesizer I90g. and the second decoded arbitrary 
shape signal Dx. as the synthesized signal Dsyn, is 
input to the display unit 104 and displayed as an image 
(StepSgiS). 

Thereafter, it Is decided whether the second coded 
arbitrary shape signal Ex is data of the last block off the 
last frame (Step Sgl 9). When it is not data of the last 
block of the last frame, a second coded arbitrary shape 
signal Ex corresporxling to the next block is subjected to 
Steps Sg1~Sg3, Sg5~Sg8, Sg18, and Sg19. Con- 
versely, when it is data of the last block of the last frame, 
decoding of the second coded arbitrary shape signal is 
ended. 

When it is decided in Step Sg2 that SID = 10, the 
input coded image signal Eo is the first coded arbitrary 
shape signal Ep including, as image information, the 
coded shape bit streams and the coded texture bit 
streams. So. the data analyzer 160g controls the switch 
lOlg with the switch control signal SWg so that the 
coded shape bit stream conresponding to each block of 
the coded arbitrary shape signal is input to the shape 
decoding unit 170 while the coded texture bit stream 
corresponding to the block is input to the texture decod- 
ing unit ISOf. Thereby, in the coded art)itrary shape sig- 
nal, the coded shape bit stream and the coded texture 
bit stream are separated from each other (Step Sg9). 
and the separated shape bit stream Is decoded by the 
shape decoding unit 170 (Step SglO) while the sepa- 
rated texture bit stream is decoded by the texture 
decoding unit 180f (Steps Sgll). The decoding proc- 
esses in Steps Sg9~Sg11 are identical to those in 
Steps Sf10-'Sf12 according to the ninth embodiment 

The decoded shape signal Dpk and the decoded 
texture signal Dpt are synthesized by the synthesizer 
190g, and the first decoded arbitrary shape signal Dp. 
as the synthesized signal Dsyn. is input to the display 
unit 104 and displayed as an image (Step Sg18). 

Thereafter, it is decided whether the first coded 
arbitrary shape signal Ep is data of the last block of the 
last frame (Step Sg19). When it is not data of the last 
block of the last frame, a first coded arbitrary shape sig- 
nal Ep corresponding to the next block is subjected to 
Steps Sgl, Sg2. Sg9-Sgll. Sgl 8. and Sgl 9. Con- 
versely, when it is data of the last block of the last frame, 
decoding of the first coded art)itrary shape signal is 
ended. 

Furthermore, when the result of the decision in 
Step Sgl is that the 2-bit code following the synchro- 
nous signal is 01 , it is decided in Step Sgl 2 whether the 
value off the image identifier (SID) is 010 or not. When 
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SID = 010. since the input coded image signal Eo is the 
coded binary signal E2 that indides only the coded 
shape bit streanrs as image information, the data ana- 
lyzer ISOg controls the switch 101g with the switch con- 
trol signal SWg so that the coded shape bit stream s 
corresponding to each block in the coded binary signal 
IS always input to the shape decoding unit 1 70. Thereby, 
in the shape decoding unit 170, the coded shape bit 
streams in the coded binary signal are subjected to 
decoding (Step Sg13). The decoding process in Step w 
Sg13 is identical to the decoding process in Step Sb2 
according to the third embodiment. TTiereafter, the 
decoded binary signal D2 is sent through the synthe- 
sizer 190g to the display unit 104 to be displayed (Step 
Sgl 8). In the synthesizer 1 90g, the decoded binary sig- is 
nal D2 may be syrtthesized with another arbitrary shape 
image signal. 

Thereafter, it is decided whether the coded binary 
signal is data of the last btock of the lasi frame (Step 
Sgl 9). When it is not data of the last tHock of the last 20 
frame, a coded binary signal con-esponding to the next 
block is subjected to Steps Sg1. Sg12. Sg13, Sgl 8. and 
Sgl 9. Conversely, when it is data of the last block of the 
last frame, decoding of the coded binary signal is 
ended. ss 

On the other hand, when the result of the decision 
in Step Sg12 is that SID is not 010. it is decided in Step 
Sgl 4 whether SID is Oil or not. When SID is not Oil, 
the decoding process by the image decoding apparatus 
1 0Og returns to Step Sgl . so 

When the result of the decision In Step Sgl 4 is SID 
= 011. since the input coded image signal Eo includes, 
as image information, the coded shape bit streams Egk 
and the coded fransparency bit streams Egt, the data 
analyzer 160g controls the switch lOlg with the switch 35 
control signal SWg so that the coded shape bit stream 
Egk corresponding to each block of the coded art)itrary 
shape signal is input to the shape decoding unit 170 
while the coded transparency bit stream Egt corre- 
sponding to the block is input to the texture decoding 40 
unit 1 80f . Thereby, in the coded transparency signal, the 
coded shape bit sfream Egk and the coded texture bit 
stream Egt are separated from each other (Step Sgl 5), 
and the separated shape bit stream Egk is decoded by 
the shape decoding unit 1 70 (Step Sgl 6) while the sep- 45 
arated transparency bit stream Egt is decoded by the 
texture decoding unit 180f (Step Sgl 7). 

That is, the coded shape bit stream Egk is decoded 
by the shape decoding unit 1 70. like the coded shape bit 
stream E2k of the binary image signal. When decoding so 
of the coded shape bit stream Egk corresponding to one 
block has ended, the arithmetic decoder 1 71 detects the 
end of the coded shape bit sfream Egk con-esponding to 
this btock and outputs an end detection signal Te toward 
the data analyzer 160g. Receiving the end detection ss 
signal Te. the data analyzer 160g controls the switch 
101g with the switch control signal SWb so that the 
input coded image signal is input to the texture decod- 



ing unit 180f. 

Thereby, the coded fransparency bit stream Egt is 
sent from the data analyzer 160g to the texture decod- 
ing unit 180f. In the decoding unit 180f. the quantization 
scale and the DOT coefficients in each bit stream are 
input to the inverse quantizer 181f. and the DCT coeffi- 
cients are subjected to inverse quantization. Thereafter, 
the inversely quantized signal Diq is sut)iected to 
inverse cosine transformation by tiie inverse cosine 
transformer 182f. 

Meanwhile, tiie fransparency motion vector MV is 
input to the texture nwtion compensator 1 841 The com- 
pensator 1 84f generates an address for obtaining a pre- 
diction transparency signal according to the 
transparency motion vector MV, and obtains the predic- 
tion texture signal Emg from the frame memory bank 
102f using tiie address. 

The adder 1 83 performs addition of tiie output Didct 
from the inverse cosine fransformer 182f and the predic- 
tion transparency signal Emg. and outputs tiie decoded 
transparency signal Dgt The decoded tunsparency 
signal Dgt is input to frie frame memory bank 102f and 
tiie synthesizer 190g. The synttiesizer ISOg synthe- 
sizes the reproduced transparency signal Dgt and the 
con-esponding reproduced shape signal Dgk witii a 
desired image to generate syntiiesized image data 
Dsyn. TTie syntiiesized image data Dsyn is input to tiie 
display unit 104 to be displayed as an image (Step 
Sgl8). When decoding of the coded transparency bit 
sfream has ended, tiie data analyzer 160g detects frte 
end of tiie coded fransparency bit sfream, and confrols 
tiie switoh 1 01 f by the switch confrol signal SWg so that 
tiie input coded image signal is input to tiie shape 
decoding unit 170. 

Thereafter, it is decided whettier tiie input coded 
signal is data of the last block of the last frame (Step 
Sgl 9). When it is not data of the last block of tiie last 
frame, an input coded data corresponding to tiie next 
block is subjected to Steps Sgl, Sg12, and 
Sg14~Sg19. Conversely, when it is data of the last block 
of the last frame, decoding of tiie input coded signal is 
ended. 

In ttiis eleventh embodiment, with respect to pixels 
wherein the reproduced shape signal is zero, pixel val- 
ues in ttie reproduced first and second artsitrary shape 
signal and the reproduced transparency signal are 
replaced witii pixel values of a prescribed image. The 
prescribed image is an Image prepared in advance at 
tiie receiving end, or an image reproduced by another 
image decoding apparatus. 

As described above, according to the eleventii 
enrtediment of the invention, the image decoding appa- 
ratus 100g includes tiie data analyzer 160g which ana- 
lyzes tiie input coded data. The data analyzer ISOg 
detects an image identifier showing which coded signal 
is the input coded image signal among the coded binary 
signal E2. tiie first and second coded arbifrary shape 
signals Ep and Ex, the coded rectangle signal Et. and 
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the coded transparency signal Eg and. according to the 
value of the image identifier, the analyzer 160g controls 
the switch 101g so that the input coded signal is appro- 
priately input to one of the shape decoding unit 1 70 and 
the texture decoding unit ISOf. Therefbre, the above- 
mentioned five coded image signals having different 
data structures can be decoded by decoding processes 
corresponding to a single coding method. 

Furthermore, in this eleventh embodiment, the 
coded texture bit stream and the coded transparency bit 
stream are decoded by the same decoding method in 
the texture decoding unit 180f. However, the coded 
transparency bit stream may be decoded by a decoding 
method different from that for the coded texture bit 
stream, as described for the ninth embodiment. 

Moreover, in this eleventh embodiment, emphasis 
has been placed on the image decoding apparatus 
100g which identifies the coded signals having the data 
structure described for the tenth emtxxjiment, i.e., first 
and second coded arbitrary shape signals, a coded 
binary signal, a coded transparency signal, and a coded 
rectangle signal, using their image identifiers, and per- 
forms decoding processes according to the respective 
data structures. However, when the image Input unit 
110 in the image cocfing apparatus 100a according to 
the second embodiment shown in figure 3 is con- 
structed so that It can identify an arbitrary shape image 
signal, a binary image signal, a rectangle image signal, 
an arbitrary shape transparency signal, and an arbitrary 
shape Image signal with transparency Information. It Is 
possible to implement an image coding apparatus that 
performs coding of these image signals with Image 
identifiers Ibr identifying the coded signals con-espond- 
ing to these image signals. 

When a coding or decoding program for implement- 
ing any of the aforementioned image coding apparatus, 
image decoding apparatuses, image coding method, 
and image decoding methods, is recorded on a data 
storage medium (e.g., a floppy disk), the image 
processing according to any of the aforementioned 
embodiments can be easily executed in an Independent 
computer system. 

Rgures 21(a)-21(c) are diagrams for explaining 
when the image coding process according to the sec- 
ond embodiment or the image decoding process 
according to any of the third, fourth, fifth, seventh, ninth, 
and eleventh embodiments is executed by a computer 
system using a floppy disk wNch contains the coding or 
decoding program. 

Rgure 21 (a) shows a front view of a floppy disk FD, 
a cross-sectional view thereof, and a f toppy disk body D. 
Rgure 21(b) shows an example of a physical format of 
the floppy disk body D. 

The floppy disk body D is contained in a case FC, 
tha'eby providing the floppy disk FD. On the surface of 
the disk body D. a plurality of tracks Tr are formed con- 
centrically from the outer circumference of the disk 
toward the Inner circumference. Each track Is divkled 



into 16 sectors in the angular direction. Therefore, in the 
fk)ppy disk FD containing the above-mentioned pro- 
gram, data of the program are recorded In assigned 
sectors on the f toppy disk body D. 
5 Rgure 21(c) shows the structure for recording the 
program in the floppy disk FD and for performing image 
processing using the program recorded in the floppy 
diskFD. 

To be specific, when the program Is recorded in the 

10 floppy disk FD. data of the program are written in the 
floppy disk FD from the computer system Cs through 
the floppy disk drive FDD. When the above-mentioned 
Image coding apparatus or Image decoding apparatus 
Is constructed in the computer system Cs from the pro- 

15 gram recorded in the floppy disk FD. the program is read 
from the floppy disk FD by the floppy disk drive FDD and 
then loaded to the computer system Cs. 

Although in the above description a fk)ppy disk is 
employed as a data storage medium, an optical disk 

20 may be enrployed. Also In this case, image coding or 
decoding can be carried out by software, in similar man- 
ner to the above-mentioned case of using the floppy 
disk. The storage medium is not restricted to the floppy 
disk and the optical disk, and any medium may be 

25 ernployed as long as it can contain the program, for 
example, an IC card or a ROM cassette. 

Furthermore, there is a case where coded image 
signals having different data structures, such as a 
coded binary signal, a coded rectangle signal, first and 

30 second coded arbitrary shape signals, and a coded 
transparency signal, are stored In a data storage 
medium such as an optical disk. 

Assuming that the coded image signals having dif- 
ferent data structures and stored in a data storage 

35 medium are coded Image signals having the data struc- 
tures with image identifiers according to any of the first, 
sixth, eighth, and tenth embodiments, when these 
coded image signals are read from the medium and 
decoded, the respective coded signals can be identified 

40 with the identifiers and decoded adaptively to the data 
structures of the coded signals by an Image decoding 
method or an image decoding apparatus corresponding 
to a single coding method. For example, coded image 
signals having different structures, such as a coded 

45 binary signal and a coded arbitrary shape signal, can be 
decoded. In this case, with respect to the coded binary 
signal, addition of a dummy coded texture signal when 
the binary signal is created is dispensed with, wheretjy 
unwanted increase in the coded bit number is almost 

so avokJed. 

Claims 

1 . A data structure for transmitting a coded image sig- 
55 nal obtained by coding a digital Image signal, 
including: 

at least coded shape bit streanr^ between the 
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image signal, and subjecting the digital image sig- 
nal to a coding process according to the data struc* 
ture of the digital image signal, comprising: 

5 signal identification mear^ for receiving the 

digital image signal, and deciding whether the 
digital image signal Is a binary image signal 
including, as data for display, only a shape sig- 
nal representing a display image of binary 
10 information, or an arbitrary shape Image signal 

including, as data for display, both of a shape 
signal representing the shape of each object as 
one of the components of a display image and 
a pixel value signal representing the gradation 
75 of the object and outputting an identifier signal 

according the result of the decision; 
signal extraction means for extracting the 
shape signal from the binary image signal, and 
the shape signal and the pixel value signal from 
20 the arbitrary shape image signal: 

first coding means for coding the shape signals 
by a first coding process to generate coded 
shape bit streams; 

second coding means for coding the pixel value 
2s signal by a second coding process employing a 

coding method different from that of the first 
coding process, ther^y generating coded pixel 
value bit streams; 

signal supply means for selecting, according to 
30 the identifier signal, one of first and second 

operations, where tiie first operation is to sup- 
ply the shape signal of tiie binary image signal 
to the first coding means, and the second oper- 
ation Is to supply the shape signal of the arbl- 
35 trary shape image signal to the first coding 

means while supplying the pixel value signal of 
the arbitrary shape image signal to the second 
coding means; and 

multiplexing means for multiplexing the identi- 
40 fier signal from the signal identification means. 

the coded shape bit streams output from tiie 
first coding means, and tiie coded pixel value 
bit streams output from tiie second coding 
means; 

45 wherein a coded binary signal including tiie 

identifier signal and the coded shape bit 
streams is output when tiie binary image signal 
is input as tiie digital image signal, and a coded 
arbitrary shape signal including the identifier 
so signal, tiie coded shape bit streams, and tiie 

coded pixel value bit streams is output when 
the art^trary shape infiage signal is Input as tiie 
digital Image signal. 
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following two kinds of bit streams: coded shape 
bit streams obtained by coding a shape signal 
which represents a display Image of binary 
information or the shape In binary format of 
each object as one of the components of a dis- 
play image; and coded pixel value bit streams 
obtained by coding a pixel value signal repre- 
senting the gradation of tiie object; and 
an in^ge Identifier for deciding whettier the 
coded image signal includes, as the coded bit 
streams, botii of tiie coded shape bit streams 
and ttie coded pixel value bit streams, or only 
tiie coded shape bit streams; 
wherein tiie image identifier and the coded bit 
streams are arranged so that tiie image identi- 
fier Is followed by the coded bit streams. 

2. The data structure for image transmission accord- 
ing to Claim 1 wherein the image Identifier com- 
prises a 2-brt code. 

3. An image coding method receiving a digital image 
signal, and subjecting tiie digital Image signal to a 
coding process according to the data structure of 
the digital image signal, wherein: 

it is decided whether the digital image signal is 
a binary image signal including, as data for dis- 
play, only a shape signal representing a display 
image of binary Information, or an art)itrary 
shape image signal including, as data for dis- 
play, both of a shape signal representing the 
shape of each object as one of ttie components 
of a display image and a pixel value signal rep- 
resenting ttie gradation of tiie object; 
for the binary image signal, ttie shape signal Is 
8ut)ject6d to a first coding process and, in tiie 
coding process, an image identifier having a 
first value is generated, thereby creating a 
coded binary signal including the Image identi- 
fier; 

for the art)itrary shape image signal, ttie shape 
signal is subjected to the first coding process 
while ttie pixel value signal is subjected to a 
second coding process employing a coding 
metiiod different from ttiat of the first coding 
process and. In the coding process, an Image 
identifier having a second value is generated, 
tiiereby creating a coded arbitrary shape signal 
including the image Identifier; and 
in response to tiie input digital image signal, 
one of ttie coded binary signal and ttie coded 
ait)itrary shape signal is output. 

4. The image coding metiiod of Claim 3 wherein the 
image identifier comprises a 2-blt code. 

5. An image coding apparatus receiving a digital 



55 6. An image decoding metiiod receiving, as a coded 
signal obtained by coding a digital image signal, a 
coded image signal having an image identifier 
according to the data structure of tiie digital image 
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Signal, and subjecting the coded image signal to a 
decoding process according to the data structure, 
wherein: 

the coded image signal is analyzed with refer- s 
ence to the Image identifier to dedde whether 
the coded image signal Is a coded arbitrary 
shape signal Including, as data for display, both 
of coded shape bit streams obtained by coding 
a shape signal which represents the shape of 10 
each object as one of the components of a dis- 
play image and coded pixel value bit streams 
obtained by coding of a pixel value signal rep- 
resenting the gradation of the object, or a 
coded binary signal including, as data for dis- is 
play, only coded shape bit streams obtained by 
coding a shape signal representing a display 
image of binary information; 
when the input coded Image signal Is the coded 
aibitrary shape signal, decoding of the coded 20 
shape bit streams thereof by a first decoding 
method, and decoding of the coded pixel value 
bit streams thereof by a second decoding 
method, are carried out according to the 
arrangement of these bit streams; arxJ 25 
when the input coded image signal is the coded 
binary signal, only decoding of the coded 
shape bit streams thereof by the first coding 
methcdlscanriedout. 

30 

7. The in^ge decoding method of Claim 6 wherein the 
image identifier comprises a 2-bit code. 

8. An image decoding apparatus receiving, as a 
coded signal obtained by coding a digital image sig- 3S 
nal, a coded Image signal having an image identi- 
fier according to the data structure of the digital 
image signal, and subjecting the coded image sig- 
nal to a decoding process according to the data 
structure, comprising: 40 

data analysis means for deciding whether the 
coded image signal is a coded arbitrary shape 
signal including, as data for display, both of 
coded shape bit streams obtained by coding a 45 
shape signal which represents the shape of 
each object as one of the components of a dis- 
play image and coded pixel value bit streams 
obtained by coding a pixel value signal repre- 
senting the gradation of the object or a coded so 
binary signal including, as data for display, only 
coded shape bit streams obtained by coding a 
shape signal representing a display Image of 
binary information; 

first decoding means for decoding the coded 55 
shape bit streams by a first decoding process 
to generate a decoded shape signal; 
second decoding means for decoding the 



coded pixel value bit streams by a second 
decoding process employing a decoding 
method different from that of the first decoding 
process, thereby generating a decoded pixel 
value signal; 

signal switch means for supplying the coded 
image signal to one of the first and second 
decoding means, according to switch control 
signals; 

said data analysis means supplying a first 
switch control signal to the signal switch means 
when the coded image signal is the coded 
binary signal, and supplying a second switch 
control signal to the signal switch means when 
the coded image signal Is the coded aitttrary 
shape signal; and 

said signal switch means being In the fixed 
switching state where the coded shape bit 
streams of the coded binary signal are input to 
the first decoding means alone when it 
recaves the first switch control signal, and 
being in the alternate switching state where, 
according to the arrangement of the coded 
shape bit streams and the coded pixel value bit 
streams In the coded artxtrary shape signal, 
the coded shape bit streams are input to the 
first decoding means while the coded pixel bit 
streams are Input to the second deciding 
means, when it receives the second switch 
control signal. 

9. The image decoding apparatus of Claim 8 further 
comprising over-load detection means for detecting 
that the load on the decoding process by one of the 
first and second decoding means exceeds a thresh- 
old value which is set in advance, and oulputting an 
over-load detection signal toward the data analysis 
means, wherein: 

when the over-toad detection signal is Input to 
the data analysis means, the data analysis 
means outputs a third switch control signal 
toward the signal switch means; and 
in response to the third switch control signal, 
the signal switch means supplies either of the 
coded shape bit streams and the coded pixel 
value bit streams In the coded art)itrary shape 
signal to one of the first and second decoding 
means. 

ia The image decoding apparatus of Claim 8 further 
comprising control signal Input means for inputting 
a manual control signal from the outside to the data 
analysis means, wherein: 

when the data analysis means receives the 
manual control means, it outputs a third switch 
control signal toward the signal switch means; 
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and 

in response to the third switch control signal, 
the signal switch means supplies the coded 
shape bit streams of the coded arbitrary shape 
signal to the first decoding means, and does 5 
not supply the coded pixel value bit streams to 
the second decoding means. 

1 1 . A data structure for transmitting a coded image sig- 
nal obtained k>y coding a digital image signal, io 
including: 



obtained by coding a shape signal repre- 
senting a display image of binary informa- 
tion; 

y&ten the input coded image signal is the coded 
pixel value signal, decoding of the coded pixel 
value bit streams thereof is canied out; and 
when the input coded image signal is the coded 
binary signal or the coded arbitrary shape sig- 
nal, decoding of the coded bit streams included 
in these signals is stopped. 



at least one of the following two kinds of coded 
bit streams: coded shape bit streams obtained 
by coding a shape signal which represents a is 
display image of binary Information or the 
shape in binary format of each object as one of 
the components of a display image; and coded 
pixel value bit streams ot>tained by coding a 
pixel value signal representing the gradation of so 
the display Image or the object; and 
an image identifier conprising a multiple-bit 
code, for deciding whether the coded image 
signal includes, as the coded bit streams, at 
least the coded shape bit streams, or only the 2S 
coded pixel value bit streams; 
wherein ^e image Identifier and the coded bit 
streams are ananged so that the image identi- 
fier is followed by the coded bit streams. 

30 

12. An image decoding method receiving, as a coded 
signal obtained by coding a digital image signal, a 
coded image signal having an image identifier 
according to the data structure of the digital image 
signal, and subjecting the coded image signal to a 35 
decoding process according to the data structure, 
wherein: 

the coded image signal is analyzed with refer- 
ence to the image identifier to decide which of 4o 
the following three coded signals is the coded 
Image signal; 

a coded arbitrary shape signal including, 
as data for display, both of coded shape bit 4S 
streams obtained by coding a shape signal 
which represents the shape of each object 
as one of the components of a display 
Image, and coded pixel value bit streams 
obtained by coding a pixel value signal rep- so 
resenting tiie gradation of tiie object 
a coded pixel value signal Including, as 
data for display, only coded pixel value bit 
streams obtained by coding a pixel value 
signal representing ttie gradation of a dis- ss 
play image, and 

a coded binary signal including, as data for 
display, only coded shape bit streams 



13. An image decoding apparatus receiving, as a 
coded signal obtained by coding a digital image sig- 
nal, a coded image signal having an image identi- 
fier according to the data structure of tiie digital 
image signal, and subjecting the coded image sig- 
nal to a decoding process according to the data 
structure, comprising: 

data analysis means for analyzing the coded 
image signal according to the image identifier 
to decide which of the following tiiree coded 
signals is the coded image signal; 

a coded arbitrary shape signal including, 
as data for display, both of coded shape bit 
streams obtained by coding a shape signal 
which represents the shape of each object 
as one of the components of a displc^ 
image, and coded pixel value bit streams 
otJtained by coding a pixel value signal rep- 
resenting tiie gradation of the object, 
a coded pixel value signal including, as 
data for display, only coded pixel value bit 
streams obtained by coding a pixel value 
signal representing tiie gradation of a dis- 
play image, and 

a coded binary signal including, as data for 
display, only coded shape bit streams 
obtained by coding a shape signal repre- 
senting a display image of binary informa- 
tion; 

decoding means for decoding tiie coded pixel 
value bit streams to generate a decoded pixel 
value signal; 

signal discarding means for discarding the 
coded image signal; 

signal switch means for supplying the coded 
image signal to one of tiie decoding means and 
tiie signal discarding means according to a 
switch control signal; 

said data analysis means supplying a first 
switch confrol signal to the signal switch means 
when the coded image signal is tiie coded pixel 
value signal, and supplying a second switch 
control signal to tiie signal switch means when 
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the coded image signal is the coded arbitrary 
shape signal or the coded binary signal: and 
said signal switch nrteans supplying the coded 
pixel value bit streams of the coded pixel value 
signal to the decoding means when it receives 
the first switch control sigrai, and sillying the 
coded bit streams included in the coded arbi- 
trary shape signal and the coded binary signal 
to the signal discarding means when it receives 
the second switch control signal. 

14. A data structure lor transmitting a coded image sig- 
nal obtained by coding a digital image signal, 
including: 

at least one of the following three Kinds of 
coded bit streams: coded shape bit streams 
obtained by coding a shape signal which repre- 
sents a display image of binary information or 
the shape in binary format of each object as 
one of the components of a display image; 
coded pixel value bit streams obtained by cod- 
ing a pixel value signal representing the grada- 
tion of the display image or the object; and 
coded transparency bit streams obtained by 
coding a multivalued transparency signal rep- 
resenting the trarsparency of the object; and 
an image identifier comprising a muttiple-bit 
code, for deciding which of the following four 
coded image signals is the coded image signal; 

a coded pixel value signal including, as the 
coded bit streams, only the coded pixel 
value bit streams, 

a first coded arbitrary shape signal includ- 
ing, as the coded bit streams, the coded 
shape bit streams and the coded pixel 
value bit streams, 

a coded binary signal including, as the 
coded bit streams, only the coded shape 
bit streams, and 

a second coded ait)itFary shape signal 
including, as the coded bit streams, the 
coded shape bit streams, the coded pixel 
value bit streams, and the coded transpar- 
ency bit streams; 

wherein the Image identifier and the coded bit 
streams are arranged so that the image identi- 
fier is followed by the coded bit streams. 

15. An image decoding method receiving, as a coded 
signal obtained by coding a digital image signal, a 
coded image signal having an Image Identifier 
according to the data structure of the digital image 
signal, and subjecting the coded image signal to a 
decoding process according to the data structure, 
wherein: 



the coded image signal is analyzed with refer- 
ence to the irrmge identifier to decide which of 
the following four coded signals is the coded 
image signal; 

a first coded arbitrary shape signal includ- 
ing, as data for display, coded shape bit 
streams obtained by coding a shape signal 
representing the shape of each oksject as 
one of the components of a display image, 
and coded pixel value bit streams obtained 
by coding a pixel value signal representing 
the gradation of the object, 
a second coded arbitrary shape signal 
including, as data for display, in addition to 
coded shape bit streams and coded pixel 
value bit streams, coded transparency bit 
streams obtained by coding a multivalued 
transparency signal representing the 
transparency of the object, 
a coded pixel value signal Including, as 
data for display, only coded pixel value bit 
streams obtained by coding a pixel value 
signal representing the gradation of a dis- 
play image, and 

a coded binary signal including, as data for 
display, only coded shape bit streams 
obtained by coding a shape signal repre- 
senting a display image of binary informa- 
tion: 

when the input coded image signal is the first 
coded arbitrary shape signal, decoding of the 
coded shape bit streams thereof by a first 
decoding method, and decoding of the coded 
pbcel value bit streams thereof by a second 
decoding method, are carried out according to 
the arrangement of these bit streams; 
when the input coded image signal is the sec- 
ond coded arbitrary shape signal, decoding of 
the coded shape bit streams thereof by the first 
decoding method, decoding of the coded pixel 
value bit streams thereof by the second decod- 
ing method, and decoding of the coded trans- 
parency bit streams thereof by a third decoding 
method, are carried out according to the 
arrangement of these bit streams; 
when the input coded image signal is the coded 
pixel value signal, only decoding of the coded 
pixel value bit streams thereof by the second 
decoding method is carried out; and 
when the input coded image signal is the coded 
binary signals only decoding of the coded 
shape bit streams thereof by the first decoding 
method is canried out 

16. A data stnjcture for transmitting a coded image sig- 
nal obtained by coding a digital image signal. 
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incUiding: 

at least one of the fbllcwing three kinds of 
coded bit streams: coded shape bit streams 
obtained by coding a shape signal which repre- s 
sents a display image of binary information or 
the shape in binary format of each object as 
one of the components of a display image; 
coded pixel value bit streams olMained by cod- 
ing a pixel value signal representing the grada- 10 
tion of the display Image or the object: and 
coded transparency bit streams obtained by 
coding a multivalued transparency signal rep- 
resenting the transparency of the object; 
an image Identifier comprising a multiple-bit is 
code, for deciding which of the following five 
coded image signals is the coded image signal; 

a coded pixel value signal including, as the 
coded bit streams, only the coded pixel 20 
value bit streams. 

a first coded arbitrary shape signal Includ- 
ing, as the coded bit streams, the coded 
shape bit streams and the coded pixel 
value bit streams. ss 
a coded binary signal including, as the 
coded bit streams, only the coded shape 
bit streams, 

a second coded arbitrary shape signal 
including, as the coded bit streams, the so 
coded shape bit streams, the coded pixel 
value bit streams, and the coded transpar- 
ency bit streams, and 
a coded transparency signal including, as 
the coded bit streams, the coded shape bit ss 
streams and the coded transparency bit 
streams; 

wherein the image identifier and the coded bit 
streams are arranged so that the image Identi- 4o 
f ier is followed by the coded bit streams. 

17. An Image decoding method receiving, as a coded 
signal obtained by coding a digital image signal, a 
coded image signal having an image identifier 45 
according to the data structure of the digital image 
signal, and subjecting the coded image signal to a 
decoding process according to the data structure, 
wherein: 

so 

the coded image signal is analyzed with refer- 
ence to the image identifier to dedde which of 
the following five coded signals is the coded 
image signal; 

ss 

a first coded arbitrary shape signal includ- 
ing, as data for display, coded shape bit 
streams obtained by coding a shape signal 



shewing the shape of each object as one 
of the components of a display image, and 
coded pixel value bit streams obtained by 
coding a pixel value signal representing 
the gradation of the object, 
a second coded arbitrary shape signal 
including, as data for display, in addition to 
coded shape bit streams and coded pixel 
value bit streams, coded transparency bit 
streams obtained by coding a nuiltivalued 
transparency signal representing the 
transparency of the object, 
a coded transparency signal including, as 
data for display, coded shape bit streams 
obtained by coding a shape signal repre- 
senting the shape of the object, and coded 
transparency bit stream obtained by cod- 
ing a multivalued signed representing the 
transparency of the object, 
a coded binary signal Including, as data for 
display, only coded shape bit streams 
obtained by coding a shape signal repre- 
senting a display image of binary informa- 
tion, and 

a coded pixel value signal including, as 
data tor display, only coded pixel value bit 
streams obtained by coding a pixel value 
signal representing the gradation of a dis- 
play image; and 

when the input coded image signal is the first 
coded aibitrary shape signal, decoding of the 
coded shape bit streams thereof by a first 
decoding method, and decoding of the coded 
pixel value bit streams thereof by a second 
decoding method, are carried out according to 
the arrangement of these bit streams; 
when the input coded image signal is the sec- 
ond coded arbitrary shape signal, decoding of 
the coded shape bit streanrs thereof by the first 
decoding method, decoding of the coded pixel 
value bit streams thereof by the second decod- 
ing method, and decoding of the coded trans- 
parency bit streams thereof by a third decoding 
method, are carried out according to the 
arrangement of these bit streams; 
when the input coded image signal is the coded 
transparency signal, decoding of the coded 
shape bit streams thereof by the first decoding 
method, and decoding of the coded transpar- 
ency bit streams by the third decoding method, 
are carried out according to the arrangement of 
these bit streams; 

when the input coded image sigr^ Is the coded 
binary signal, only decoding of the coded 
shape bit streams thereof by the first decoding 
method Is carried out; and 
when the input coded image signal is the coded 
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pixel value signal, only decoding of the coded 
pixel value bit streams thereof by the second 
decoding method is carried out 

18. A data storage medium containing a program for s 
implementing a decoding process of a coded image 
signal by a con^uter. said program being con- 
structed so that a deoodng process according to an 
image decoding method as defined in any of Claims 

6. 12, 15, and 17 is executed by the computer. io 

19. A data storage medium containing a coded image 
signal obtained by cocfing a digital image signal, 
said coded image signal having a data structure for 
image transmission as defined in any of Claims 1, is 
11, 14, and 16. 
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Fig.23 (a) 
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Fig.24 (a) 
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